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1^ (57) Abstract: A melhod for integrating test modules in a modular test system is disclosed. The method includes controlling at least 
one test module and its corresponding device under test, DUT, with a controller, establishing a standard module control interface 
between a vendor-supplied test module and the modular test system with a module control framework, installing the vendor-supplied 
lest module and a corresponding vendor-supplied control software module, where the vendor-supplied control software module is 
organized into a plurality of vendor-supplied module control components, configuring the modular test system based on the module 
control framework and the plurality of vendor- suppUed module control components, and accessing the vendor-supplied test module 

1^ in accordance with the plurality of vendor-supplied module control components using the module control framework. 
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METHOD AND SYSTEM FOR CONTROLLING INTERCHANGEABLE 
COMPONENTS IN A MODULAR TEST SYSTEM 

5 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] This application is a continuation-in-part application and claims the benefit of 
co-pending U.S. application no. 10/772,434, "Method and Structure to Develop a Test 
Program for Semiconductor Integrated Circuits," filed February 6, 2004, which claims the 

1 0 benefit of application no. 60/447,839, "Method and Structure to Develop a Test Program 
for Semiconductor Integrated Circuits," filed February 14, 2003; this application also 
claims the benefit of U.S. provisional application no. 60/573,577, "Software Development 
in an Open Architecture Test System" filed May 22, 2004; all of which are assigned to 
Advantest Corporation and all of which are incorporated herein in their entirety by 

15 reference. 

BACKGROUND OF THE INVENTION 

Field of Invention 

[0002] The present invention relates to the field of automated test equipment (ATE) for 
semiconductor testing. In particular, the present invention relates to a method and system 
20 for controlling interchangeable components in a modular test system. 

Description of Related Art 

[0003] A major reason for the high cost of test equipment is the specialized nature of 
conventional tester architecture. Each tester manufacturer has a number of tester platforms 
that are not only incompatible across companies such as Advantest, Teradyne, and Agilent, 

25 but also incompatible across platforms within a company, such as the T3300, T5500, and 
T6600 series testers manufactured by Advantest. Because of these incompatibilities, each 
tester requires its own specialized hardware and software components, and these 
specialized hardware and software components cannot be used on other testers. In addition, 
a significant effort is required to port a test program fi-om one tester to another, and to 

30 develop third-party solutions. Even when a third-party solution is developed for a platform. 
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it cannot be ported or reused on a different platform. The translation process from one 
platform to another is generally complex and error prone, resulting in increased effort, time, 
and test cost. 

[0004] Another problem of the specialized tester architecture is that all hardware and 
5 software remain in a fixed configuration for a given tester. To test a device-under-test 
(DUT) or an integrated circuit (IC), a dedicated test program is developed that uses some 
or all of the tester capabilities to define the test data, signals, waveforms, current, and 
voltage levels, as well as to collect the DUT response and to determine DUT pass/fail. 
[0005] Since a test system needs to exercise a wide range of functionalities and 

10 operations in order to test a wide variety of test modules and their corresponding DUTs, 
there is a need for an open architecture test system that can be configured to support the 
wide variety of test modules. Specifically, in order to support the wide variety of test 
modules, there is a need for a module control framework within the open architecture test 
system that can be configured to support the integration of one or more vendor modules 

1 5 into the test system during testing of a particular vendor module and its corresponding 
DUTs. 

SUMMARY OF THE INVENTION 
[0006] This application describes test program development using object-oriented 
constructs, e.g., C++ objects and classes. In particular, this method is suitable for 

20 developing test programs for an open architecture tester, such as that described in U.S. 

application serial nos. 60/449,622, 10/404,002 and 10/403,817, assigned to the assignee of 
the present invention. 

[0007] An embodiment of the present invention provides a rriethod for developing a 
test program by describing test system resources, test system configuration, module 

25 configuration, test sequence, test plan, test condition, test pattern and timing information in 
general-purpose object-oriented, e.g., C/C++, constructs to test a device under test, e.g., an 
IC, on a semiconductor test system, such as automated test equipment (ATE). The files 
containing these descriptions .are stored in memory, i.e., a computer-readable medium, 
accessible to the test system or related equipment that uses the files. 

30 [0008] Describing test system resources may comprise specifying a resource type, 

where the resource type is associated with at least one test module for applying a test to the 
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IC, specifying a parameter type associated with the resource type, and specifying a 
parameter of the parameter type. 

[0009] Describing test system configuration may comprise specifying a site controller 
for controlling at least one test module, where each test module applies a test to the IC, and 
5 specifying an input port of a module connection enabler. The test system couples the site 
controller to the module connection enabler at the specified input port, and the module 
connection enabler couples the site controller to a test module. The module connection 
enabler may be implemented as a switch matrix. 

[0010] Describing module configuration may comprise specifying a module identifier 
10 for specifying a module type, specifying executable code for controlling a test module of 
the module type specified by the module identifer, and specifying a resource type 
associated with the test module. The executable code may take the form of a dynamic link 
library. 

[0011] Describing module configuration may further involve the user specifying a slot 

1 5 identifier for specifying an output port of the module connection enabler, where the test 

system couples the test module to the module connection enabler at the output port, and the 
module connection enabler couples the test module to a corresponding site controller. The 
user may also specify a vendor identifier for identifying the provider of the test module, 
and an identifier of the maximiim number of resource units available in connection with 

20 the resource type. The resource type may be, for example, digital tester pins and the 
resource \mits tester channels. Alternatively, the tester channel resource units may also 
correspond to resource types such as, for example, analog tester pins, RF tester pins, power 
supply pins, digitizer pins, and arbitrary waveform generation pins. An indicator relating 
to which resource units are disabled may also be provided. The resource units indicated as 

25 disabled may represent defective resource units of the test module. 

[0012] Describing test conditions may comprise specifying at least one test condition 
group, specifying a specification set including at least one variable; and specifying a 
selector for selecting an expression to be bound to a variable. Association of the test 
condition group with a selector for the specification set defines a test condition. 

30 [0013] Describing a test sequence may comprise specifying the order (or flow) in 
which various tests can be applied. 
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[0014] Describing test patterns may comprise specifying the test patterns, associated 
voltage and current levels, transitions in signal values, corresponding rise and fall times 
and associated timing. 

[0015] An embodiment of the present invention also includes the use of preheader files. 
5 A preheader file is compiled to create a header file for a class associated with a test entity. 
The preheader includes a parameter block for specifying parameters for setting at least one 
attribute of the test entity, and a template block for specifying source code that is inserted 
by a compiler into the header file for the test entity class. The header file may be a C++ 
header file. The test entity may be a test and the test entity class may be a test class, for 

10 example. The parameters may relate to pattern lists and test conditions, for example. 
[0016] A pattern compiler of an embodiment of the invention includes at least one 
module-specific pattern compiler, and an object file manager for directing each module- 
specific compiler to compile both a corresponding module-specific section of a pattern 
source file and a common section of the pattern source file. The common section includes 

15 information accessible to all of the module-specific compilers. An output of the compiler 
includes at least one module-specific pattern data section. Module-specific pattern loaders 
load into corresponding test modules module-specific pattern data from corresponding 
module-specific pattern data sections for execution. 

[0017] A method for integrating test modules in a modular test system includes 
20 controlling at least one test module and its corresponding device-under-test (DUT) with a 
controller, establishing a standard module control interface between a vendor-supplied test 
module and the modular test system with a module control framework, installing the 
vendor-supplied test module and a corresponding vendor-supplied control software module, 
where the vendor-supplied control software module is organized into a plurality of vendor- 
25 supplied module control components, configuring the modular test system based on the 
module control framework and the plurality of vendor-supplied module control 
components, and accessing the vendor-supplied test module in accordance with the 
plurality of vendor-supplied module control components using the module control 
framework. 

30 [0018] A modular test system includes a controller for controlling at least one test 
module and its corresponding device-under-test (DUT) and a module control framework 
for establishing a standard module control interface between a vendor-supplied test module 
and the modular test system. The modular test system fiirther includes means for installing 
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the vendor-supplied test module and a corresponding vendor-supplied control software 
module, where the vendor-supplied control software module is organized into a plurality of 
vendor-supplied module control components, means for configuring the modular test 
system based on the module control framework and the plurality of vendor-supplied 
5 module control components, and means for accessing the vendor-supplied test module in 
accordance with the plurality of vendor-supplied module control components using the 
module control framework. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0019] The aforementioned features and advantages of the invention as well as 
10 additional features and advantages thereof will be more clearly understood hereinafter as a 
result of a detailed description of embodiments of the invention when taken in conjunction 
with the following drawings. 

[0020] Figure 1 illustrates a conventional tester architecture. 
[0021] Figure 2 illustrates a tester architecture according to an embodiment of the 
1 5 present invention. 

[0022] Figure 3 illustrates a tester software architecture according to an embodiment of 
the present invention. 

[0023] Figure 4 illustrates a test program compiler according to an embodiment of the 
present invention. 

20 [0024] Figure 5 illustrates how different test instances may be derived from a single 
test class according to an embodiment of the present invention. 
[0025] Figure 6 illustrates a pattern compiler according to an embodiment of the 
present invention. 

[0026] Figure 7 illustrates an ordered pattern tree example according to an embodiment 
25 of the present invention. 

[0027] Figure 8 illustrates another ordered pattern tree example according to an 
embodiment of the present invention. 

[0028] Figure 9 illustrates the relationships among files that are required by a test 
program according to an embodiment of the present invention. 
30 [0029] Figure 1 0 illustrates waveform generation according to an embodiment of the 
present invention. 
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[0030] Figure 1 1 illustrates a mapping used for timing according to an embodiment of 

the present invention. 

[0031] Figure 12 illustrates anotlier mapping used for timing according to an 
embodiment of the present invention. 
5 [0032] Figure 13 illustrates a method for integrating a vendor software module to the 
open architecture test system according to an embodiment of the present invention. 
[0033] Figure 14 illustrates a module control framework according to an embodiment 
of the present invention. 

DESCRIPTION OF EMBODIMENTS 

10 [0034] Methods and systems are provided for controlling interchangeable components 
in a modular test system. The following description is presented to enable any person 
skilled in the art to make and use the invention. Descriptions of specific embodiments and 
applications are provided only as examples. Various modifications and combinations of 
the examples described herein will be readily apparent to those skilled in the art, and the 

1 5 general principles defined herein may be applied to other examples and applications 

without departing from the spirit and scope of the invention. Thus, the present invention is 
not intended to be limited to the examples described and shown, but is to be accorded the 
widest scope consistent with the principles and features disclosed herein. 
[0035] The present invention is generally described in terms of the Open architecture 

20 test system as disclosed in U.S. application serial nos. 60/449,622, 10/404,002 and 

10/403,817 by the same assignee. Those skilled in the art will recognize, however, that 
embodiments of the test program development system and method of the present invention 
are applicable not only to an open tester architecture, but also to fixed tester architectures, 
as well. 

25 [0036] A description of the open architecture test system may be found in U.S. 

application no. 10/772,327, "Method and Apparatus for Testing Integrated Circuits," which 
claims the benefit of U.S. application no. 60/449,622 by the same assignee. 
[0037] Figure 1 illustrates a generalized architecture of a conventional tester showing 
how a signal is generated and applied to a device-under-test (DUT). Each DUT input pin 

30 is cormected to a driver 2 that applies test data, while each DUT output pin is connected to 
a comparator 4. In most cases, tri-state driver-comparators are used so that each tester pin 
(channel) can act either as an input pin or as an output pin. The tester pins dedicated to a 
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single DUT collectively form a test site that works with an associated timing generator 6, 
waveform generator 8, pattern memory 10, timing data memory 12, waveform memory 
data 14, and block 16 that define the data rate. 

[0038] Figure 2 illustrates a system architecture 1 00 according to an embodiment of 
5 the present invention. A system controller (SysC) 102 is coupled to multiple site 

controllers (SiteCs) 104. The system controller may also be coupled to a network to access 
files. Through a module cormection enabler 106, each site controller is coupled to control 
one or more test modules 108 located at a test site 110. The module connection enabler 
106 allows reconfiguration of connected hardware modules 108 and also serves as a bus 

1 0 for data transfer (for loading pattern data, gathering response data, providing control, etc.). 
Possible hardware implementations include dedicated connections, switch connections, bus 
coimections, ring connections, and star connections. The module connection enabler 106 
may be implemented by a switch matrix, for example. Each test site 1 10 is associated with 
a DUT 1 12, which is connected to the modules of the corresponding site through a 

1 5 loadboard 114. In one embodiment, a single site controller may be connected to multiple 
DUT sites. 

[0039] The system controller 102 serves as the overall system manager. It coordinates 
the site controller activities, manages system-level parallel test strategies, and additionally 
provides for handler/probe controls as well as system-level data-logging and error handling 

20 support. Depending on the operational setting, the system controller 102 can be deployed 
on a CPU that is separate from the operation of site controllers 104. Alternatively a 
common CPU may be shared by the system controller 102 and the site controllers 104. 
Similarly, each site controller 104 can be deployed on its own dedicated CPU (central 
processing unit), or as a separate process or thread within the same CPU. 

25 [0040] The system architecture can be conceptually envisioned as the distributed 

system shown in Figure 2 with the understanding that the individual system components 
could also be regarded as logical components of an integrated, monolithic system, and not 
necessarily as physical components of a distributed system. 

[0041] Figure 3 illustrates a software architecture 200 according to an embodiment of 
30 the present invention. The software architecture 200 represents a distributed operating 

system, having elements for the system controller 220, at least one site controller 240, and 
at least one module 260 in correspondence to related hardware system elements 1 02, 1 04, 
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108. In addition to the module 260, the architecture 200 includes a corresponding element 
for module emulation 280 in software. 

[0042] As an exemplary choice, the development environment for this platform can be 
based on Microsoft Windows. The use of this architecture has side benefits in program 
5 and support portability (e.g., a field service engineer could connect a laptop which runs the 
tester operating system to perform advanced diagnostics). However, for large compute- 
intensive operations (such as test pattern compiles), the relevant software can be made as 
an independent entity capable of running independently to allow job scheduling across 
distributed platforms. Related software tools for batch jobs are thus capable of rurming on 

10 multiple platform types. 

[0043] As an exemplary choice, ANSI/ISO standard C++ can be taken as the native 
language for the software. Of course, there are a multitude of options available (to provide a 
layer over the nominal C++ interfaces) that allows a third party to integrate into the system 
with an alternative language of its own choice. 

1 5 [0044] Figure 3 illustrates a shading of elements according to their organization by 
nominal source (or collective development as a sub-system) including the tester operating 
system , user components 292 (e.g., supplied by a user for test purposes), system 
components 294 (e.g., supplied as software infrastructure for basic connectivity and 
communication), module development components 296 (e.g., supplied by a module 

20 developer), and external components 298 (e.g., supplied by external sources other than 
module developers). 

[0045] From the perspective of source-based organization, the tester operating system 
(TOS) interface 290 include: System Controller to Site Controller interfaces 222, 
framework classes 224, Site Controller to Module interfaces 245, framework classes 246, 

25 predetermined module-level interfaces, backplane communications library 249, chassis slot 
IF (Interface) 262, loadboard hardware IF 264, backplane simulation IF 283, loadboard 
simulation IF 285, DUT simulation IF 287, Verilog PLI (programming language interface) 
288 for DUT's Verilog model and C/C++ language support 289 for DUT's C/C++ model. 
[0046] User components 292 include: a user test plan 242, user test classes 243, 

30 hardware loadboard 265, and DUT 266, a DUT Verilog model 293 and a DUT C/C++ 
model 291. 
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[0047] System components 294 include: system tools 226, communications library 
230, test classes 244, a backplane driver 250, HW backplane 261, simulation framework 
281, backplane emulation 282, and loadboard simulation 286. 
[0048] Module-development components 296 include: module commands 
5 implementation 248, module hardware 263, and module emulation 284. 
[0049] External components 298 include external tools 225. 

[0050] The system controller 220 includes interfaces 222 to site controller, framework 
classes 224, system tools 226, external tools 225, and a communications library 230. The 
System Controller software is the primary point of interaction for the user. It provides the 

10 gateway to the Site Controllers of the invention, and synchronization of the Site 
Controllers in a multi-site/DUT environment as described in U.S. application no. 
60/449,622 by the same assignee. User applications and tools, graphical user interface 
(GUI)-based or otherwise, run on the System Controller. The System Controller also may 
act as the repository for all Test Plan related information, including Test Plans, test patterns 

15 and test parameter files. The memory storing these files may be local to the system 

controller or offline, e.g., connected to the system controller through a network. A test 
parameter file contains parameterization data for a Test class in the object oriented 
envirorunent of an embodiment of the invention. 

[0051] Third party developers can provide tools in addition to (or as replacements for) 
20 the standard system tools 226. The standard interfaces 222 on the System Controller 220 

include interfaces that the tools use to access the tester and test objects. The Tools 

(applications) 225, 226 edlow interactive and batch control of the test and tester objects. 

The tools include applications for providing automation capabilities (through, for example, 

the use of SECS/TSEM, etc.) 
25 [0052] The Communications library 230 residing on the system controller 220 provides 

the mechanism to communicate with the Site Controllers 240 in a manner that is 

transparent to user applications and test programs. 

[0053] The Interfaces 222 resident in memory associated with the System Controller 
220 provide open interfaces to the fi-amework objects that execute on the System 
30 Controller. Included are interfaces allowing the Site Controller-based module software to 
access and retrieve pattern data. Also included are interfaces that applications and tools 
use to access the tester and test objects, as well as scripting interfaces, which provide the 
ability to access and manipulate the tester and test components through a scripting engine. 
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This allows a common mechanism for interactive, batch and remote applications to 
perform their functions. 

[0054] The Framework Classes 224 associated with the System Controller 220 provide 
a mechanism to interact with these above-mentioned objects, providing a reference 
5 implementation of a standard interface. For example, the site controller 240 of the 

invention provides a functional test object. The system controller framework classes may 
provide a corresponding flmctional test proxy as a remote system controller-based 
surrogate of the functional test object. The standard functional test interface is thus made 
available to the tools on the system controller 220. The framework classes effectively 

10 provide an operating system associated with the host system controller. They also 
constitute the software elements that provide the gateway to the Site Controllers, and 
provide synchronization of the Site Controllers in a multi-site/DUT environment. This 
layer thus provides an object model in an embodiment of the invention that is suitable for 
manipulating and accessing Site Controllers without needing to deal directly with the 

1 5 Communications layer. 

[0055] The site controller 240 hosts a user test plan 242, user test classes 243, standard 
test classes 244, standard interfaces 245, site controller framework classes 246, module 
high level command interfaces (i.e., predetermined module-level interfaces 247, module 
commands implementation 248, backplane communications library 249, and a backplane 

20 driver 250. Preferably most of the testing functionality is handled by the site controllers 
104/240, thus allowing independent operation of the test sites 1 10. 
[0056] A Test Plan 242 is written by the user. The plan may be written directly in a 
standard computer language employing object-oriented constructs, such as C++, or 
described in a higher level test programming language to produce C++ code, which can 

25 then be compiled into the executable test program. For test program development, one 
embodiment of the invention employs assignee's inventive Test Program Language (TPL) 
compiler. Referring to Figure 4, the test program compiler 400 acts in part as a code 
generator including a translator section 402 to translate a test program developer's source 
files 404 describing tests and associated parameters into object-oriented constructs, such as 

30 C++ code. A compiler section 406, in turn, compiles and links the code into executables, 
e.g., DLLs, to create the test program that may be executed by the tester system. Although 
the application of the TPL code generator/translator to test systems is novel, please note 
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that code generators are known in the art. Also, the compiler section may be a standard 

C++ compiler known in the art. 

[0057] The test plan creates test objects by using the Framework Classes 246 and/or 
standard or user supplied Test Classes 244 associated with the site controllers, configures 
5 the hardware using the Standard Interfaces 245, and defines the test plan flow. It also 
provides any additional logic required during execution of the test plan. The test plan 
supports some basic services and provides an interface to the services of underlying objects, 
such as debug services (e.g., break-pointing), and access to underlying framework and 
standard classes. 

10 [0058] The source code input to the test program compiler 400 includes a Test Plan 
description file that specifies the objects used in a test plan and their relationships to one 
another. This file is translated to C++ code that is executed on the Site Controller in the 
form of an implementation of a standard interface, which may be denoted ITestPlan. 
This code is packaged into a Windows dynamic link library (DLL), which may be loaded 

15 onto the Site Controller. The Test Program DLL is generated to have standard known 

entry points that the Site Controller software can use to generate and return the TestPlan 
object it contains. The Site Controller software loads the Test Program DLL into its 
process space and uses one of the entry points to create an instance of the Test Plan object. 
Once the Test Plan object has been created, the Site Controller software can then execute 

20 the test plan. 

[0059] The Framework classes 246 associated with the site controllers are a set of 
classes and methods that implement common test-related operations. The site controller- 
level fi"amework includes, for example, classes for power supply and pin electronics 
sequencing, setting level and timing conditions, obtaining measurements, and controlling 

25 test flow. The fi-amework also provides methods for runtime services and debugging. The 
framework objects may work through implementing the standard interfaces. For example, 
the implementation of the TesterPin framework class is standardized to implement a 
general tester pin interface that test classes may use to interact with hardware module pins, 
[0060] Certain framework objects may be implemented to work with the help of the 

30 module-level interfaces 247 to communicate with the modules. The site controller 
framework classes effectively act as a local operating system supporting each site 
controller. 
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[0061] In general more than ninety percent of the program code is data for the device 
test, and the remaining ten percent of the code realizes the test methodology. The device 
test data is DUT-dependent (e.g., power supply conditions, signal voltage conditions, 
timing conditions, etc.). The test code consists of methods to load the specified device 
5 conditions on to ATE hardware, and also those needed to realize user-specified objectives 
(such as datalogging). The framework of an embodiment of the invention provide a 
hardware-independent test and tester object model that allows the user to perform the task 
of DUT test programming. 

[0062] To increase the reusability of test code, such code may be made independent of 

1 0 any device-specific data (e.g., pin name, stimulus data, etc.), or device-test-specific data 
(e.g., conditions for DC units, measurement pins, number of target pins, name of pattern 
file, addresses of pattern programs). If code for a test is compiled with data of these types, 
the reusability of the test code would decrease. Therefore, according to an embodiment of 
the invention, any device-specific data or device-test-specific data may be made available 

15 to the test code externally, as inputs during code execution time. 

[0063] In an embodiment of the invention, a Test Class, which is an implementation of 
a standard test interface, denoted here as ITest, realizes the separation of test data and 
code (and hence, the reusability of code) for a particular type of test. Such a test class may 
be regarded as a "template" for separate instances of itself, which differ from each other 

20 only on the basis of device-specific and/or device-test-specific data. Test classes are 
specified in the test plan file. Each Test class typically implements a specific type of 
device test or setup for device test. For example, an embodiment of the invention may 
provide a specific implementation of the ITest interface, for example, 
FunctionalTest, as the base class for all fimctional tests for DUTs. It provides the 

25 basic fiinctionality of setting test conditions, executing patterns, and determining the status 
of the test based on the presence of failed strobes. Other types of implementations rnay 
include AC and DC test classes, denoted here as ACParametricTests and 
DCParametricTests. 

[0064] All test types may provide default implementations of some virtual methods 
30 (e.g., init ( ) , preExec < ) , and postExec ( ) ). These methods become the test engineer's entry 
points for overriding default behavior and setting any test-specific parameters. However, 
custom test classes can also be used in test plans. 
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[0065] Test classes allow the user to configure class behavior by providing parameters 
that are used to specify the options for a particular instance of that test. For example, a 
Functional Test may take parameters PList and TestConditions, to specify the Pattern List ' 
to execute, and the Level and Timing conditions for the test, respectively. Specifying 
5 different values for these parameters (through the use of different "Test" blocks in a test 
plan description file) allows the user to create different instances of a Functional Test. 
Figure 5 illustrates how different test instances may be derived from a single test class. 
These classes may be programmed directly in object-oriented constructs, such as C++ code, 
or designed to allow a test program compiler to take the description of .the tests and their 

10 parameters from a test plan file and generate corresponding C++ code, which can be 

compiled and linked to generate the test program. A Template Library may be employed 
as the general-purpose library of generic algorithms and data structures. This library may 
be visible to a user of the tester, so that the user may, for example, modify the 
implementation of a test class to create a user-defined test class. 

1 5 [0066] As to user-developed test classes, an embodiment of the system supports 
integration of such test classes into the framework in that all test classes derive from a 
single test interface, e.g., ITest, so that the framework can manipulate them in the same 
way as the standard set of system test classes. Users are free to incorporate additional 
functionality into their test classes, with the understanding that they have to use custom 

20 code in their test programs to take advantage of these additional facilities. 

[0067] Each test site 110 is dedicated to testing one or more DUTs 106, and functions 
through a configurable collection of test modules 112. Each test module 1 12 is an entity 
that performs a particular test task. For example, a test module 1 12 could be a DUT power 
supply, a pin card, an analog card, etc. This modular approach provides a high degree of 

25 flexibility and configurability. 

[0068] The Module Commands Implementation classes 248 may be provided by 
module hardware vendors, and implement either the module-level interfaces for hardware 
modules, or provide module-specific implementations of standard interfaces, depending on 
the commands implementation method chosen by a vendor. The external interfaces of 

30 these classes are defined by pre-determined module level interface requirements, and 

backplane communications library requirements. This layer also provides for extension of 
the standard set of test commands, allowing the addition of methods (functions) and data 
elements. 
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[0069] The Backplane Communications Library 249 provides the interface for standard 

communications across the backplane, thereby providing the functions necessary to 
communicate with the modules connected to the test site. This allows vendor-specific 
module software to use a Backplane Driver 250 to communicate with the corresponding 
5 hardware modules. The backplane communications protocol may use a packet based 
format. 

[0070] Tester Pin objects represent physical tester channels and derive from a tester pin 
interface, denoted here as ITesterPin. The software development kit (SDK) of an 
erribodiment of the invention provides a default implementation of ITesterPin, which 
10 may be called TesterPin, which is implemented in terms of a predetermined module-level 
interface, IChaimel. Vendors are free to make use of TesterPin if they can implement their 
module's fiinctionality in terms of IChaimel; otherwise, they must provide an 
implementation of ITesterPin to work with their module. 

[0071] The standard module interface, denoted here as IModule, provided by the tester 

15 system of the invention generically represents a vendor's hardware module. Vendor- 
supplied module-specific software for the system may be provided in the form of 
executables such as dynamic link libraries (DLLs). Software for each module-type from a 
vendor may be encapsulated in a single DLL. Each such software module is responsible 
for providing vendor-specific implementations for the module interface commands, which 

20 comprise the API for module software development. 

[0072] There are two aspects of the module interface commands: first, they serve as the 
interface for users to communicate (indirectly) with a particular hardware module in the 
system, and second, they provide the interfaces that third-party developers can take 
advantage of to integrate their own modules into the site controller level framework. Thus, 

25 the module interface commands provided by the framework are divided into two types: 

[0073] The first, and most obvious, are those "commands" exposed to the user through 
the framework interfaces. Thus, a tester pin interface (ITesterPin) provides methods 
to get and set level and timing values, while a power supply interface (I PowerSupply) 
provides methods for powering up and powering down, for example. 

30 [0074] In addition, the framework provides the special category of the predetermined 
module-level interfaces, which can be used to communicate with the modules. These are 
the interfaces used by framework classes (i.e., "standard" implementations of framework 
interfaces) to communicate with vendor modules. 
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[0075] However, the use of the second aspect, the module-level interfaces, is optional. 
The advantage of doing so is that vendors may then take advantage of the implementations 
of classes such as ITesterPin and IPowerSupply, etc. while focusing on the content of 
specific messages sent to their hardware by implementing the module-level interfaces. If 
these interfaces are inappropriate to the vendor, however, they may choose to provide their 
custom implementations of the framework interfaces (e.g., vendor implementations of 
ITesterPin, IPowerSupply, etc.). These would then provide the custom functionality that is 
appropriate for their hardware. 

[0076] With this open architecture as backgroxmd, the test program development 
system of the present invention is further described as follows. Section A below describes 
rules to describe the test envirormient in which test program will be used; ; section B 
describes the method and rules for test program development; section C specifies the 
method and rules to develop a test plan and how to define the main structure of the test 
program; section D describes how to run a test program on an open architecture test 
system; section E describes a method and rules for test patterns; section F describes rules 
to describe the timing of the test patterns; and section G describes rules for the overall 
tester operation. 

A. Components 

[0077] The test environment comprises a set of files that specify the necessary 
conditions for bringing up the tester, and for preparing it to run a set of tests. The test 

environment preferably includes files for: 

1. Tester Resource definition: for the specification of the types of tester 
resources — and supported parameters for such resources — that are 
available in the open architecture test system. 

2. Tester configuration: for the specification of Site Controllers, sites and 
corresponding mappings. 

3. Module configuration: for specification of the hardware module in each 
site 

4. Pin descriptions: for naming of DUT pins, such as signal pins, power 
supplies, and to describe pin groups, 

5. Socket: for the specification of DUT pin-to-tester pin assignments 
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6. Pin options: for the specification of special options, or modes, for pins. 

7. Pattern lists: for the specification of test patterns and their sequence. 

8. Patterns: for the specification of test vectors. 



[0078] Of the above, items 1-3 are created by ICF (installation and configuration files) 
5 with information from a CMD (configuration management database), and made available 
at a well-known location, while items 4-8 are user-specified. This section provides 
descriptions for the items 1-6 above; items 7-8 are described in more detail in section E. 
Specific methods and rules are preferably used to develop each of these components; these 
methods and rules will be described in this section with examples. 

10 Al. The Resource Definition 

[0079] Each hardware module provides one or more types of hardware resources 
(resources for short) for use by the test system. The tester Resource Definition is 
preferably used to declare a set of resource names for the available resource types, and a 
set of parameter names and types associated with each particular resource type. For 

1 5 instance, the resource name dpin is used to refer to digital tester pins. These resources 
have parameters such as VIL (for the input low voltage), VIH (for the input high voltage), 
VOL (for the output low voltage), VOH (for the output high voltage), etc. A resource 
definition file will have the extension ".rsc". Shown below is an example resource 
definition, containing some tester resources: 

20 # 

# File Resources.rsc 
# 

Version 0.1.2; 

ResourceDefs 
25 { 

# digital pins 
dpin 

{ 

# Low and High voltages for input pins 
30 Voltage VIL, VIH; 

# Low and High voltages for output pins 
Voltage VOL, VOH; 

} 

# power supplies 
35 dps 
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{ 

# 

# PRE WAIT specifies the time to wait after voltage 

# reached its final value to start pattern 

5 # generation. The actual time that the system 

# will wait is a small system specified range: 

# PRE_WAIT-delta <= actual <= PRE_WAIT+delta 
# 

# PRE_WAIT_MIN is a minimum amount to wait after voltage 
10 # reached its final value to start pattern generation. 

# It is a system specified range: 

# PRE_WAIT_MIN <= actual <= 
PRE_WAIT_MIN+delta 

# 

1 5 # POST WAIT specifies the time to wait after pattern 

# generation ends to shut down the power. The actual 

# time that the system will wait is a small system 

# defined range: 

# POST_WAIT-delta <= actual <= POST_WAIT+delta 
20 # 

# POST_WAIT_MIN specifies the time to wait after pattern 

# generation ends to shut down the power. The actual 

# time that the system will wait is a small system 

# defined range: 

25 # POST_WAIT_MIN <= actual <= 

POST_WAIT_MIN+delta 
# 

Time PRE_WAIT; 
Time PRE_WAIT_MIN; 
30 Time POST_WAIT; 

Time POST_WAIT_MIN; 

# The voltage. 
Voltage VCC; 

} 

35 } 

[0080] Note that the type of a resource parameter (such as Voltage or Time) is 

preferably a standard engineering unit. Vendors supplying special purpose resources that 

prefer the specification of different parameters should provide their own resource 

definition files. 

40 Structure for the Resource Definition 

[0081] Given below is a structure for the resource definition file in accordance with a 

preferred embodiment of the present invention: 

resource-file: 

version-info resource-defs 



wo 2005/114240 PCT/JP2005/009815 

18 

version-info: 

Version version-identifer ; 

resource-defs: 

ResourceDefs { resource-def-list } 

5 resource-def-list: 

resource-def 

resource-def-list resource-def 

resource-def. 

resource-name { resource-params-decl-list } 

1 0. resource-params-decl-list: 

resource-params-decl 

resource-params-decl-list resource-params-decl 

resource-params-decl : 

elementary-type-name resource-param-name-list ; 

1 5 resource-param-name-list: 

resource-param-name 

resource-param-name-list , resource-param-name 
[0082] Undefined non-terminals above are specified below: 

1 . version-identifier: A sequence of one or more characters fi"om the set 
20 [0-9a-zA-Z.]. It represents a version number. 

2. resource-name: A sequence of one or more characters from the set 
[a-zA-Z_0-9], not starting with a digit. It represents the name of a 

resource, such as dpin or dps. 

3. eleraentary-type-name: A sequence of one or more characters from 
25 the set [a-zA-Z_0-9], not starting with a digit. It represents the name 

of an elementary type, such as Voltage (cf.). 

4. resource-param-name: A sequence of one or more characters from 
the set [a-zA-Z_0-9], not starting with a digit. It represents the name 
of a resource parameter, such as VIL. 

30 A2, Tester Conflguration 

[0083] The The Tester Configuration is a set of rules that is preferably used to list the 
Site Controllers in a particular system configuration, and the connection of the Site 
Controllers to the Switch Matrix input ports. In the architecture of an embodiment of the 
invention, a single Site Controller can be connected to a single switch matrix input port. 

35 Thus, in this context, the switch matrix coiuiections serve as implicit identifiers for the Site 
Controllers in the system (other configurations are possible). The following is an example 
of a typical tester configuration: 
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# 

# Tester Configuration, Sys.cfg 

# 

Version 1.2.5; 

5 SysConfig 

{ 

# 

# The first field is the hostname of the Site Controller machine; 

# it can be specified as either a dotted-decimal IP address or a 
10 # domain-qualified hostname. 

# 

# The second field is the switch matrix input port number, which 

# implicitly serves as the identifier for the Site Controller 

# connected to it. 
15 # 

zeus.olympus.deities.org 2; 
127.0.0.2 4; 
127.0.0.0 1;#SITEC-1 
127.0.0.3 3; 

20 } 

[0084] The system configuration for a particular test-floor system is part of the system 

profile, and is made available as the system configuration file Sys.cfg. Note that in one 

embodiment the Site Controller connected to port 1 ("127.0.0.0" in the above example) 

may enjoy special status, in which it alone configures the Switch Matrix. This "special" 

25 Site Controller will be referred to as SITEC-1 . Also note that the site controller address in 

this example is an IP address because the site controllers may be connected to the system 

controller by an internal network. Conversely, the system controller may be connected to 

an external network to access files, such as pattern data. 

Structure for the Tester Configuration 

30 [0085] Given below is a structure for the system configuration file in accordance with 

an embodiment of the present invention: 

system-config-file : 

version-info system-config 

version-info: 

35 Version version-identifer ; 

system-config: 

SysConfig { site-controller-connection-list } 

site-controller-connection-list: 
site-controller-connection 
40 site-controller-connection-list site-controller-connection 
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site-controller-connection: 

site-controller-hostname input-port ; 

site-controller-hostname: 

ip-address 

5 domain-qualified-hostname 

ip-address: 

octet . octet . octet . octet 

domain-qualified-hostname : 
name 

10 domain-qualified-hostname . name 

[0086] Undefined non-terminals above are specified below: 

1 . version-identifier: A sequence of one or more characters from the set 
[0-9a-zA-Z.]. It represents a version number. 

2. octet: A noimegative integer fi"om 0 to 255 (in decimal notation). 

15 3. name: A sequence of one or more characters from the set [a-zA-Z_0-9], 

not starting with a digit. It represents a name segment in a domain- 
qualified hostname. 

4. input-port: A noimegative integer, in decimal notation. 

A3. The Module Configuration 

20 [0087] The Module Configuration allows the specification of the physical 

configuration of the tester, e.g., the physical location and type of each module in a SYSTEM 
chassis. This is necessitated by the dynamic nature of the tester bus configuration, which 
allows a mapping of the tester bus address to the physical slot location. This information 
allows a hardware discovery process that occurs at system boot-up time to validate the 

25 SYSTEM configuration. Each output port of the Switch Matrix defines a physical slot, 

which is preferably occupied by a single hardware module. Shown below is an example of 
a module configuration specified in the file Modules.cfg in accordance with an 
embodiment of the invention: 
# 

30 # Module Configuration File, Modules.cfg 

# 

Version 0.0.1; 

ModuleConfig 
{ 

35 # 

# A configuration definition which provides information about 

# the module type that is attached to slots 1-12 and 32-48. 

# Note that a module might provide more than 
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# a single type of resource. 
Slot 1-12, 32-48 



{ 

VendorlDl; 
ModulelDl; 
ModuleDriver modl.dll; 

# 

# Resource named dpin specifies channels 

# for digital data. The name dpin is not 

# a keyword. It is simply the name of a hardware 

# resource, and is obtained from the resource 

# definition file. 
# 

Resource dpin 
{ 

MaxAvailable32; # Resource units 1 .. 32. 

} 

Resource analog 
{ 

MaxAvailablel6; # Resource units 1 .. 16. 

Disabled 1-8; # Disabled resources 1 .. 8. 

# So, enabled ones are 9 .. 16. 

} 

} 

# 

# A configuration definition which provides information about 

# the module type that is attached to slots 16-30, 50, and 61-64. 

# 

Slot 16-30, 50,61-64 
{ 

Resource dpin 
{ 

MaxAvailable32; # Max available resource units. 

Disabled 3, 30-32; # Disabled resources. • 

} 

ModuleDriver 
VendorlD 
ModulelD 

} 

# 

# A configuration definition, which provides information about 

# the module type that is attached to slots 65-66. 
# 

Slot 65-66 



# Switch matrix output ports 

# which use the configuration 

# defined below. 

# defined vendor code. 

# Vendor-defined id code. 

# Module software. 



"module two.dll"; 

2; 
2; 
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{ 



ModuIelD 

ModuIeDriver 

VendorlD 



4; 



# DPS module with 8 supplies. 



mod4.dll; 



# 



# Resource type dps specifying resource units for a 

# Device Power Supply 



# 



Resource dps 
{ 



MaxAvailable4; 



Disabled 1 ; 



} 



} 



[0088] As mentioned earlier, in one embodiment a slot refers to connector through 
which a hardware module can be connected, such as an output port of the switch matrix. 
Each configuration definition provides information about the module that may be attached 
to one or more slots. The VendorlD specified in a configuration definition is a unique ID 
associated with a vendor. The ModulelD refers to a type of module provided by this 
vendor. There may be several instances of the same ModulelD in a tester configuration. 
The ModuIeDriver refers to a vendor supplied DLL to service the module. Finally, the 
Resource refers to the units serviced by this module, and provides a name for the resource 
type; the resource name is obtained from the resource definition file. 
[0089] The above example describes three configuration blocks in a module 
configuration file. In one implementation, the first configuration block, slots 1-12 and 32 
- 48 are serviced by a module produced by vendor 1 . This vendor provides the module, 
the identifier "1" to refer to this module type, and the module driver library to control the 
module. This module can provide two types of resource units, one designated by the 
resource name "dpin", with preferably a total number of 32 resource units (i.e., "channels"), 
all of which are available, and the other designated by the resource name "analog", with a 
total number of 16 resource units, of which only 9 through 16 are available. The second 
and third configuration blocks are specified in a manner similar to the first configuration. 
[0090] Note that the provision for allowing channels to be denoted as "disabled" is to 
allow for the identification of defective resource units on modules that are still fianctional 
otherwise. Note also that a configuration block may have one or more slot identifiers. 
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When a block has more than a single slot identifier, then the identified slots are said to be 
cloned. 

[0091] The module configuration file, Modules.cfg, is created as part of the system 
profile by the ICM (installation configuration management system) (with test-floor- 
5 specific information provided by the user), and made available at a well-known location. 
The ICM is a utility that can be local to the test system, e.g., on the system controller, or 
reside elsewhere on the network to which the system controller is connected. The ICM 
manages the CMD (configuration management database), and typically updated on 
hardware changes to the system configuration. ICM allows the user to configure the 
10 system, e.g., site controllers and modules. The CMD is a database that stores the 

configurations. For actual tester configuration/operation ICM generates the configuration 
files, e.g., module configuration, and other files, and copies them and associated files, such 
as particular module DLLs, onto the tester. 

Structure for Module Configuration 
1 5 [0092] Below is the module configuration structure in accordance with the preferred 
embodiment: 

file-contents: 

version-info module-config-def 

version-info: 

20 Version version-identifier ; 

module-config-def: 

ModuleConfig { slot-entry-list } 

slot-entry-list: 
slot-entry 

25 slot-entry-list slot-entry 

slot-entry: 

Slot positive-integer-list { slot-info } 

slot-info: 

required-config-list 

30 required-config-list: 

required-config 

required-config-list required-config 

required-config: 

VendorlD id-code ; 
35 ModulelD id-code ; 

ModuIeDriver file-name ; 

Resource resource-name { max-spec disabled-spec opt } 
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max-spec: 

MaxAvailable positive-integer ; 

disabled-spec: 

Disabled positive-integer-list ; 

positive-integer-list: 

positive-integer-list-entry 
positive-integer-list , positive-integer-list-entry 

positive-integer-list-entry: 
positive-integer 
positive-integer-number-range 



1 . version-identifier: A sequence of one or more characters from the set 
[{)-9a-zA-Z.], where the first character must be from the set [0-9]. 

2. positive-integer: A sequence of one or more characters from the set [0- 
9], not starting with a 0. 



4. resource-name: A sequence of one or more characters from the set [a- 
zA-Z_0-9], where the first character must be from the set [a-zA-Z]. 



[0094] Comments are supported; comments start with the '#' character, and extend to 
the end of the line. 

A4. Pin Descriptions 

[0095] The DUT pin descriptions are described using a Pin Descriptions file. The user 
makes available a description of the DUT pins in a pin description file, which has the 
extension .pin. This plain text file contains, at least the following: a listing of the DUT pin 
names; and initial definitions of named pin groups, which make use of the defined DUT 
pin names ("initial" since they can be subsequently modified or added to, etc., 
programmatically). 

[0096] The separation of this data specification from the Test Plan description allows 
general reuse of the DUT pin definitions, and allows the pattern compiler to derive pin 
names (required for resolving references to pin names used in vector specifications) from 
the pin description file, without having the process tied to a specific Test Plan. 
[0097] Shown below is an example pin description file: 



[0093] 



positive-integer-number-range: 
positive-integer - pos-integer 
Undefined non-terminals above are described below: 



3. 




# 



# Pin description file, myDUT.pin. 
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# 

# Note that this implicitly imports the resource 

# configuration file,Resources.rsc. 
# 

5 Version 1.1.3a; 

PinDescription 
{ 

Resource dpin 
{ 

10 AO; 

Al 
A2 
A3 
A4 

15 # This syntax expands, to the names "ABUS[ 1 ] " and "ABUS [2] " 

ABUS[1:2]; 

A5; 

BBUS[1:8]; 
DIR; 

20 CLK; 

Group Grpl 
{ 

DIR, CLK, AO, Al, A2, A3, A4, BBUS[1 :4] 

} 

25 Group Grp2 

{ 

A5, 
# 

# The following line will expand to 
30 #"DIR, Al, A2, A4, A5, BBUS[2] ": 

# 

Grpl - CLK- AO- A3-BBUS[1}-BBUS[3:4] +A5, 
BBUS[5:8] 

} 

35 } 

Resource dps 
{ 

vccl; 
vcc2; 

40 vcc3; 

Group PSG 

{ 

vccl, vcc2 

} 

45 } 
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} 

[0098] Note that the DUT pin and pin group definitions are encapsulated within 
resource type blocks, to allow the compiler to correlate pin and pin group definitions with 
the allowable parameter settings for Levels, etc. 
5 [0099] The following points about pin descriptions should be noted: 

1. Pin groups and pins share the same namespace and have global (i.e.. 
Test Plan) scope. One of the consequences of the global scoping of 
these names is that pins and pin groups carmot use duplicated names, 
even when declared in different resource blocks. 

10 2. At least one Resource definition is required in the pin description file. 

3. At least one pin name should be defined in each resource. 

4. Pin and group names are required to be unique within resource 
boundaries. 

5. The same pin or group name can be defined for two or more resources. 
1 5 However, duplicates within the same resource are ignored. 

6. All pin names and group names that appear in a group definition should 
have been already defined within that resource. 

7. Group definitions, if given, should have at least one pin name or group 
name (i.e., a group definition cannot be empty). 

20 8. A pin group definition can include a reference to a previously-defined 

pin group. 

9. A pin group definition can include set operations such as addition and 
subtraction of previously defined pins and/or pin groups. 

Structure for the Pin Descriptions 
25 [0100] Given below is the structure for the pin descriptions in accordance with the 
preferred embodiment of the present invention: 

pin-description-file: 

version-info pin-description 

version-info: 

30 Version version-identifer ; 

pin-description: 

PinDescriptioD { resource-pins-def-list } 

resource-pins -def-l ist: 
resource-pins-def 
35 resource-pins-def-list resource-pins-def 

resource-pins-def: 

Resource resource-name { pin-or-pin-group-def-list } 

pin-or-pin-group-def-list: 
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pin-or-pin-group-def 

pin-or-pin-group-def-list pin-or-pin-group-def 

pindef-or-pin-groupdef: 
pin-def; 

5 pin-group-def 

pin-def: 
pin-name 

pin-name [ index : index ] 
pin-group-def: 

1 0 Group pin-group-name { pin-group-def-item-list } 

pin-group-def-item-list: 

pin-def 

pin-group-def-item-list , pin-def 
15 [0101] Undefined non-terminals above are specified below: 

1 . version-identifier: A sequence of one or more characters from the set 
[0-9a-zA-Z.]. It represents a. version number. 

2. resource-name: A sequence of one or more characters from the set [a- 
zA-Z_0-9] not starting with a digit. It represents the name of a resource, 

20 . such as dpin or dps. 

3. pin-name: A sequence of one or more characters from the set [a-zA- 
Z_0-9] not starting with a digit. It represents the name of a pin AO. 

4. pin-group-name: A sequence of one or more characters from the set [a- 
zA-Z_0-9] not starting with a digit. It represents the name of a pin 

25 group ABUS. 

5. index: A nonnegative integer. It represents the lower bound or an upper 
bound on a group of related pins. 

AS. The Socket 

[0102] The Socket specifies the mapping between DUT pin names and physical tester 
30 pin (channel) assignments (the physical tester channel numbers are defined in the module 
configuration file). Note that different Sockets can be used to support different DUT 
packages and different load board configurations, etc. For a multi-DUT system, the Socket 
definitions for DUT/channel assignments can support "cloning" of a basic Socket to 
multiple sites. However, different Sockets (i.e., different physical mappings for the same 
35 logical pins) should respect site module partitions. Thus, in addition to providing DUT pin 
to tester channel assignments, the socket also effectively defines the site partitioning. A 
Socket file could thus contain definitions for several individual site sockets. Shown below 
is a sample socket file defining three DUT sites: 
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Version 1.1.3 

SocketDef 

{ 

DUTType CHIP3 
5 { 

PinDescription dutP3.pin; # The pin description file for CHIP3 

DUT 2 # Uses the full-specification syntax 
{ 

SiteControlIer 1; # Switch Matrix input port 

10 Resource dpin 

{ 

# 

# The CLK pin is assigned to resource dpin, 

# slot 2, resource unit (channel) 13. 
15 # 

CLK 2.13; 

# 

# The DIR pin is assigned to resource dpin, 

# slot 5, resource unit 15. 
20 DIR 5.15; 

# 

# The following statement will be expanded to 

# BBUS[7] 5.4 

# BBUS[6] 5.5 
25 # BBUS[5] 5.6 

# 

# So for example, the pin sequence BBUS[7], BBUS[6], 

# BBUS[5] is assigned to the same slot 5, and to 

# resource units 4, 5 and 6 respectively. 
30 # 

BBUS[7:5] 5.[4:6]; 

BBUS[1:4] 7.[21:18]; ' 
BBUS[8] 9.16; 

} 

35 Resource dps 

{ 

# 

# The VI pin is assigned to resource dps, 

# slot 1 , resource unit (channel) 1 . 
40 # 

VCCl 1.1; 

# 

# The VCC2 pin is assigned to resource dps, 

# slot 1, resource unit (channel) 2. 
45 # 
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VCC2 1.2; 

} 

} # End DUT 2 

DUT 1 # This is "cloned" from DUT 2 above 
5 { 

SiteController 1; # Same Site Controller as for DUT 2 

Resource dpin 
{ 

SlotOfTset 1 ; # Offset value for slots 

10 } 

Resource dps 
{ 

SlotOfTset 10; # Offset value for slots 

} 

15 # 

# The offset syntax above indicates that the slot/resource 

# unit assigiunents are "cloned" from the first DUT defined 

# for this DUTType, i.e., DUT 2, with the slots offset by 

# the SlotOfTset values. 
20 # 

# Looking at the definition of dpin resource units for 

# DUT 2, CLK is bound to slot 2. Hence, for the present 

# DUT, CLK is bound to slot 2+1=3. 
# 

25 # Some of the new bindings in effect due to the offset 

# assignments are shown in the table below: 
# 

# 

# Pin Resource RUnit Slot 
30 # 

# CLK dpin 13 2+ 1 = 

3 

# DIR dpin 15 5 + 1 = 

6 

35 # BBUS[8] dpin 16 9+ 1 = 10 

# VCCl dps 1 1 + 10=11 

# VCC2 dps 2 1 + 10=11 
# 

} # End DUT 1 

40 } # End DUTType CHIP3 

DUTType 74LS245 
{ 

PinDescription dutLS.pin; 

DUT 3 disabled # This DUT site is disabled, and will be 

45 ignored 

{ 
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} 

} # End DUTType 74LS245 
} # End SocketDef 

5 

[0103] The following points about a Socket file should be noted: 

1 . The Socket file uses information from both module configuration file, 
and the user's pin description files for the given DUT types (see 
specification for PinDescription in the example above). The module 
10 configuration information is made implicitly available to the Socket file 

compiler. The socket file compiler is a sub-part of the pattern compiler 
that reads and analyzes the socket DUT name to tester channel mapping, 
and the module configuration and pin description files to set up the 
mapping of tester pins to DUT pins used by the pattern compiler. 

15 2. At least one DUT site definition per DUT type is required, and it must 

use the fiiU-specification syntax, as opposed to the SlotOffset syntax. If 
more than one DUT site definition is provided for the same DUT type, 
the first one must use the fiill-specification syntax. 

3. Each subsequent DUT site definition (for the same DUT type) may use 
20 either the fiill-specification syntax or the SlotOffset syntax, but not both. 

This allows individual sites to deviate fi"om a standard pattern (due to, 
for example, inoperative channels). 

4. The bindings derived from the SlotOffset syntax are defined relative to 
the first site defined for that DUT type (which uses the fiill-specification 

25 syntax). 

5. DUT sites do not need to be declared in the actual physical order. This 
allows a case where the first (physical) site deviates from the pattern. 

6. The DUT site IDs are required to be unique across the entire Socket (i.e., 
across all DUT types defined therein). 

30 7. At least one resource definition is required per'DUT site definition. 

8. The site definitions must be used in conjunction with the module 
configuration to determine if the test configuration is single-site/single- 
DUT or single-site/multi-DUT. 

9. In all cases, the Socket file should specify a set of DUT channel 
35 mappings which are consistent with the pin description file and the 

module configuration file. 

10. In some cases, it will be desirable to allow the Socket definition to 
specify that one or more DUT charmels are disconnected from the tester 
(for example, by designating the assigned physical channel as one with 

40 the special ID "0.0"). In this case, these DUT channels may be used and 

referenced in the context of the test program. Operations on such 
channels will result in system warnings (but not errors.). At load time, 
pattern data for disconnected channels will be discarded. 
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Structure for the Socket 

[0104] Below is the structure for the module configuration in accordance with a 

preferred embodiment of the present invention: 

socket-file: 

version-info sochst-def 

version-info: 

Version version-identifer ; 

socJxt-def: 

SocketDef { device-specific-socket-def-list } 

device-specific-socket-def-list: 
device-specific-socket-def 

device-specific-socket-def-list device-specific-socket-def 

device-speciflc-socket-def: 

DUTType DUT -type-name { pin-description-file dut-info-list } 

pin-description-file: 

PinDesc pin-description-file-name ; 

dut-info-list: 
dut-info 

dut-info-list dut-info 

dut-info: 

DUT dut-id { site-controller-input-port resource-info-list } 

site-controller-input-port: 

SiteControUer switch-matrix-input-port-number ; 

resource-info-l ist: 
resource-info 

resource-info-list resource-info 

resource-info: 

Resource resource-name { resource-item-unit-assignment-list } 

resource-item-unit-assignment-list: 
resource-item-unit-assignment 

resource-item-unit-assignment-list resource-item-unit-assignment 

resource-item-unit-assignment: 

resource-item-name slot-number . resource-unit ; 
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resource-item-name [ resource-item-index ] slot-number , resource- 
unit-index ; 

resource-item-name [ resource-item-index-range ] \ 
slot-number . [ resource-unit-index-range ] ; 

5 

resource-item-index-range: 

resource-item-index : resource-item-index 

resource-unit-index-range: 
10 resource-unit-index : resource-unit-index 

[0105] Undefined non-terminals above are specified below: 

1 . version-identifier: A sequence of one or more characters from the set 
[0-9a-zA-Z.]. It represents a version number. 

1 5 2. DUT- type-name: A sequence of one or more characters from the set [0- 

9a-zA-Z.], where the first character must not be fijom the set [0-9]. It 
represents a type of DUT, such as CHIPS. 

3. pin-description-file-name: The simple name of a file, not including its 
directory name, but including all extensions. The filename is of the 

20 syntax recognized by the host operating system, and allows blanks and 

other characters if enclosed in quotes. 

4. switch-matrix-input-port-number: A nonnegative integer in decimal 
notation to represent the port number of the input port connected to the 

Site Controller. 

25 5. dut-id: A nonnegative integer in decimal notation to identify an instance 

of a DUT. 

6. resource-name: A sequence of one or more characters fi"om the set [0- 
9a-zA-Z.], where the first character must not be a digit. It represents 
the name of a resource defined in a resource file. 

30 7. resource-itera-name: A sequence of one or more characters from the set 

[0-9a-zA-Z.], where the first character must not be a digit. It 
represents the name of a resource unit, such as a pin or a pin group. 

8. resource-item-index: A normegative integer in decimal notation that 

represents a particular member of a group of resource items. When in 
35 the context of a resource- item-index-range it represents the lower or 

upper bound of a contiguous sequence of resource item group. 

9. resource-unit-index: A normegative integer in decimal notation that 
represents a particular member of a group of resource units (channels). 
When in the context of a resource-unit-index-range it represents the 

40 lower or upper bound of a contiguous sequence of resource unit group. 

A6. Pins 

[0106] Note that in addition to logical pin name to physical channel mappings (as 
provided by the Socket), several attributes can be used for specifying the tester resources. 
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For example, options might be used to define particular hardware configurations for 
channels, which may be test-specific, vendor-specific, and/or test system-specific. These 
will be described using the Pin Mode Options, and made available via a Pin Mode Options 
file. 

5 [0107] A Pin Mode Option definition would support the configuration of special 
options or modes for a tester channel. This could, for example, be used to select and 
configure charmel multiplexing. It is preferred that the Pin Mode Option only be used as 
part of a Test Plan initialization flow, since it might require significant channel 
configuration. The Pin Option syntax supports vendor-defined options. An example is 
10 shown below: 

PinModeOptions 

{ 

clock IN double; 
aO OUT single; 

15 

}; 

Test Environment Configuration 

[0108] As pointed out earlier, the resource definition file (Resources.rsc), the system 
20 configuration file (Sys.cfg) and the module configuration file (Modules.cfg) are preferably 

made available at a "well-known" location. This "well-known" location is the directory 

specified by the value of the system environment variable Tester ACTIVE CONFIGS. 

For example, if the value of Tester ACTIVE CONFIGS is the directory 

F:\Tester_SYS\configs, the system vnll expect the following files to be present: 
25 F:\Tester_SYS\configs\Resources.rsc 

F:\Tester_SYS\configs\Sys.cfg 

F:\Tester_SYS\configs\Modules.cfg 

[0109] During installation, the Installation and Configuration Management system 
(ICM) residing on the host computer will preferably set the value of 
30 Tester_ACTIVE_CONFIGS. Every time the ICM creates a new version of one of the 
above files, it will place the new version in the location pointed to by 
Tester_ACTIVE_CONFIGS. Note that in addition to the above three files, other system 
configuration files such as the simulation configuration file are also placed in the location 
pointed to by Tester_ACTIVE_CONFIGS 
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B. Rules for Test Program Development 

[0110] One of the two principal end-user oriented components of the tester system is 
the test environment. The other component is the programming facility that the tester 
makes available for the end user (i.e., test engineer and test class developers). 
5 [0111] The principal component of the programming environment is the test plan. The 
test plan uses test classes (which are different implementations of a test interface denoted 
Test), which realize the separation of test data and code for particular types of tests. 
[0112] The plan may be written directly as a C++ test program, or described in a test 
plan description file, which is pro(iessed by a Test Program Generator (translator 402) to 
1 0 produce object-oriented code, such as C++ code. The generated C++ code can then be 
compiled into the executable test program. The data required for populating a test class 
instance, such as levels, timings, etc., are specified by the user in the test plan description 
file. 

[0113] A test program contains a set of user written files that specify details for 
15 running a test on a device. An embodiment of the invention includes sets of rules that 
permit a user to write these files using C++ constructs. 

[01 1 4] One of the requirements according to the embodiment of the invention is to 

follow the modularity of the open architecture test system.. A modular development 

permits users to write individual components dealing with different aspects of the test, and 
20 then permits these components to be mixed and matched in various ways to yield a 

complete test program. A test program in accordance with the preferred embodiment of 

the present invention comprises a set of files as follows: 

files *.usrv for user variables and constants; 

files *.spec for specification sets; 
25 files *.lvl for levels; 

files *.tim for timings; 

files *.tcg for test condition groups; 

files *.bdefs for bin definitions: 

files *.ph for a pre-header, files for custom fixnctions and test classes. 
30 files *.ctyp for custom types; 

files *.cvar for custom variables; and 
files * .tpl for test plans. 
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[0115] The file extensions above are a recommended convention facilitating 
categorization of files. A single test program vv'ill preferably comprise a single test plan 
file, and the files it imports. An "import" refers to other files v/ith data that is either 
directly referenced by the importer (the file that specifies the import), or is imported by 
5 some other file directly referenced by the importer. The test plan file could define globals, 
flows, and other such objects within it, or it could import this information from other files. 
These rules allows any of the above components to be either in their own individual files, 
or directly inlined into a test plan file. Note that the test plan is similar in concept to a C- 
lariguage main() function. 

1 0 Test Program Features 

User Variables and Constants, 

Specification Set, 

Levels, 

Timings, 
1 5 Test Conditions 

Bin Definition 

Pre-Headers 

Custom Types 

Custom Variables 
20 Test Plan 

[0116] Test program identifiers preferably start with an upper or lower case 
alphabetical character, and can subsequently have any number of alphabetical, numerical, 
or underscore ( _ ) characters. It has several keywords which are j3rovided in the 
description given below. These keywords are visually identified in code in this document 
25 using a bold font, such as Version. Keywords are reserved, and preferably not be used as 
identifiers. There are several special symbols such as {,},(,), :, and others which are 
described below. 

Elaboration of Test Objects 

[0117] An import of a test description file enables the importing file to refer to names 
30 of objects made available by the imported file. This allows the importing file to reference 
the objects named by the imported file. Consider a socket file aaa.soc that imports a pin 
description file xxx.pin. There could be another bbb.soc file that also imports xxx.pin. 



10 
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However, neither of these imports cause the objects described by xxx.pin to come into 

existence. They merely reference objects that are already assumed to exist. 

[0118] The question arises: when do such objects come into existence? This is where 

the Test Plan file is fundamentally different. In an analogy to C, it would be a file with a 

mainQ routine in it. An "Import" statement in test plan file will elaborate these objects, 

that is, cause these objects to come into existence. The test plan mickey.tpl shown below 

causes the objects in xxx.pin and aaa.soc to be elaborated: 

# File for Mickey's TestPlan 
Version 3.4.5; 



# 

# These import statements will actually cause the 

# objects to come into existence: 
# 

15 Import xxx.pin; # Elaborates pin and pin-group objects 

Import aaa.soc; # Elaborates site socket map objects 

# Other imports as necessary 

Flow Flowl 
20 { 

} 

[0119] An import of xxx.pin in the test plan causes all the pin and pin group objects 
declared in xxx.pin to be elaborated. This is described as follows: "the file xxx.pin is 
25 elaborated". It is not necessary for a Test Plan to directly import all the files that need to 
be elaborated. A file x is imported by a file y if either of the two statements below is true: 

1 . y has an import statement that names x; or 

2. X is imported by z, and y has an import statement naming z. 



30 [0120] When a test program is compiled, it will elaborate all the objects in the files that 
are imported by the test plan. The set of files imported by a test plan are topologically 
sorted to yield an order in which the files are elaborated. The set of files imported by a test 
plan is referred to as the import closure of the test plan. If the import closure of a test plan 
carmot be topologically sorted, then there must be an imports cycle. Such a situation is 

35 erroneous, and will be rejected by the compiler. 
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User Variables and Constants 

[0121] Global variables and constants will be defined using the User Variables and 
Constants. . Constants are objects whose value is bound at compile time, and cannot be 
changed. The maximum integer value, for instance, would be a constant. On the other 
5 hand, the expression bound to variables can change at runtime via an API. 
Integer, 

Unsignedlnteger, 

Double, 

String, 

10 Voltage in Volts (V), 

VoltageSlew in Volts per Second (VPS), 

Current in Amps (A), 

Power in Watts (W), 

Time in Seconds (S), 
1 5 Length in Meters (M), 

Frequency in Hertz (Hz), 

Resistance in Ohms (Ohms), and 

Capacitance in Farads (F). 

[0122] The types Integer, Unsignedlnteger, Double, and String are referred to as Basic 
20 Types. The Basic Types have no measurement units. The Elementary Types which are 

not basic types are a Double, with an associated measurement unit and a scale. The scaling 

symbols are common engineering scaling symbols: 

p (pico) for 10-12, as in pF (pico-farad) 

n (nano) for 10-9, as in nS (nano-second) 
25 u (micro) for 10-6, as in uS (micro-second) 

m (milli) for 10-3, as in mV (milli-amp) 

k (kilo) for 10+3, as in kOhm (kilo-ohm) 

M (mega) for 10+6, as in MHz (mega-hertz) 

G (giga) for 10+9, as in GHz (giga-hertz) 
30 [0123] A separate file with user variables and constants will have the extension .usrv. 

Below is an example of a file with some global constants. An example of a file with some 

variables is given later. 
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# File limits.usrv 

# 

Version 1.0.0; 

5 

# 

# This UserVars collection declaration declares a set of 

# globally available variables and constants. 

# 

10 UserVars 

{ 

# Some constant Integer globals used in various places. 
Const Integer Maxinteger = 2147483647; 
Const Integer Minlnteger = -2147483648; 

15 

# Smallest value such that 1.0 + Epsilon != 1.0 
Const Double Epsilon = 2.2204460492503131e-016; 

# Some important constants related to Double 

20 Const Double MaxDouble = 1.7976931 348623 158e+308; 

Const Double MinDouble = - MaxDouble; 

Const Double ZeroPlus = 2.2250738585072014e-308; 

Const Double ZeroMinus = - ZeroPlus; 

25 } 

[0124] The set of UserVars declared above are considered definitions of the variable on 
the left of the '='. As a result, a single occurrence of the definition of a variable or 
constant is preferred, and it should be initialized. 

30 [0125] As mentioned earlier, constants should not be changed once they are defined. 
The expression bound to a constant can involve previously defined constants and literal 
values. Variables, on the other hand, can be changed via an API.' The expression bound to 
a variable can involve previously defined variables, constants and literal values. 
[0126] Each variable is bound to an expression object which is maintained at runtime. 

35 This provides the capability of changing the expression associated with a variable at 

runtime, and then re-evaluating all the variables. The expression object is a parsed form of 
the right hand side of a variable or constant definition. In one embodiment, no facility is 
provided for the changing of constants at runtime. Their value is preferably fixed at 
compile time. 

40 [0127] Any number of such files with globals can exist in the import closure of a test 
plan. While the above globals file is a set of numeric limits, here is a set of engineering 
globals using engineering measurement units, and some random user variables: 
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# 

# File myvars.usrv 
# 



5 Version 0.1; 

# 

# This declares a UserVars collection of some engineering 

# globals. 
10 # 

UserVars MyVars 

{ 

# Engineering quantities. 

Const Voltage VlnLow = 0.0; # 0 Volts 

1 5 Const Voltage VInHigh = 5.0; # 5 Volts 

Const Voltage VOutLow = 400.0 mV; # 400 milliVolts 

Const Voltage VOutHigh = 5.1; #5.1 Volts 

Const Time DeltaT = 2.0E-9; # 2 nanoseconds 

Const Time ClkTick = 1 .0ns; # 1 nanosecond 

20 Const Resistance RIO = 10.0 kOhms; # 10 kilo Ohms 

# Some variables are declared below. 

Current ILow = 1.0 mA; # 1 milHAmp 

Current IHigh = 2.0 mA; # 2 milHAmp 

25 Power PLow = ILow * VlnLow; # Low power value 

Power PHigh = IHigh * VInHigh; # High power value 

# 

# An array of low values for all A bus pins. 
30 # The vil for AO will be in ABusVil[0], for Al 

# in ABusVil[l], and so on. 
# 

Voltage ABusVil[8] = {1.0, 1.2, Others =1.5}; 



} 



35 



[0128] The compiler preferably checks that units and types match up. Note that since a 
Voltage times a Current yields a Power, the equations for PLow and PHigh above will 
compile. However, a statement such as the following will typically not compile: 
# 

40 # Does not compile because a Current and a Voltage cannot be added 

# to yield a Power. 

# 

Power Pxxx = IHigh + VInHigh; 
[0129] The compiler will allow certain automatic type conversions: 

45 Power Pxxx = 2; # Set the power to 2.0 watts 

Integer Y = 3.6; # Y gets assigned 3 
Power Pyyy = Y; # Pyyy gets assigned 3.0 watts 
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Double Z = Pyyy; # Pyyy gets converted to a unitless Double 
[0130] Explict type conversion to Double, Unsignedlnteger and Integer is also 

permitted: 

Power Pxxx = 3.5; 

5 

# Explicit type conversion is allowed, but not required. 

# X becomes 3.5 

Double X = Double(Pxxx); # X becomes 3.5 
Integer Y = Integer(Pxxx); U Y becomes 3 
10 [0131] Conversion between unrelated types is also possible, by converting to an 

intermediate basic type: 

Power Pxxx = 3.5; 

# Explicit type conversion is required. 

15 Length L = Double(Pxxx); # L becomes 3.5 meters 

Voltage V = Integer(Pxxx); # V becomes 3.0 Volts. 
[0132] The TestPlan object provides a UserVars class which is a collection that 

contains names and their associated expressions, values, and types. User variables can go 

into a Default User Variables Collection, or into a Named User Variables Collection. The 

20 UserVars declarations in the example above, which have no specified name, go into the 

default collection. However, it is possible to explicitly name a collection as follows: 

# Declare X and Y in the MyVars UserVars collection. 
UserVars MyVars 

{ 

25 Integer X = 2.0; 

# 

# Refers to the above X, and to the globally 

# available Maxinteger from the default 

# UserVars collection. 
30 # 

Integer Y = Maxinteger - X; 

} 

# Declare X, Yl and Y2 in the YourVars UserVars collection. 
UserVars YourVars 

35 { 

Integer X = 3.0; 

# Refers to the X from MyVars. 
Integer Yl = Maxinteger - MyVars.X; 

# Refers to the X declared above. 
40 Integer Y2 = Maxinteger - X; 

} 

# More variables being added to the MyVars collection 
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UserVars MyVars 

{ . 
# 

# Refers to X and Y from the earlier declaration 
5 # of MyVars. 

# 

Integer Z = X + Y; 

} 

[0133] Name resolution within a UserVars collection proceeds as follows: 
10 If a name is qualified — i.e., a name comprises two segments separated by a dot 

— then the variable comes from a named user variables collection, named by the segment 
that precedes the dot. So, MyVars.X above refers to the X in the MyVars collection. The 

name "_UserVars" can be used to explicitly denote the default user variables collection. 
[0134] If the name is not qualified, and there is a constant or variable of the same name 
1 5 in the present collection, then the name resolves to that constant or variable. 

[0135] Otherwise, the name resolves to a constant or variable in the default user 
variables collection. 

[0136] Evaluation of a block of definitions in a UserVars collection can be thought of 
happening sequentially, from the first definition to the last. This may require each variable 

20 being defined before it is used. 

[0137] Furthermore, there could be several blocks of definitions for a UserVars 
collection, each of which are defining several variables. All of these blocks of definitions 
can be thought of as being evaluated in declaration order in the test plan, and then the 
variables of each block are also checked in declaration order. 

25 [0138] Finally, there could be several UserVars collections, each of which define 

variables over several blocks of definitions. All of the variables again can be thought of as 
being initialized in declaration order. Thus, in the above example, the evaluation order 
would be: MyVars.X, MyVars. Y, YourVars.X, YourVars.Yl, YourVars.Y2, MyVars. Z. 
[0139] When a UserVars collection uses a variable from another collection, it 

30 preferably uses just the raw value of the variable. No dependency information is 

maintained between collections. Thus, dependency based re-evaluation can be limited to a 
single collection. 

[0140] Each user variables collection refers to an instance of a C++ UserVars class. 
The default object of the C++ UserVars class is named "_UserVars". Variables in an 
35 UserVars declaration that is uimamed are fi-om the default user variables collection, and are 
added to this default object. Variables in a named user variables collection are added to an 
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object of the C++ UserVars class having that name. In the above example, the "MyVars" 
C++ object will end up having the variables X, Y and Z. 
[0141] C++ for User Variables 

[0142] User variables are implemented as a collection of n-tuples having the name 

5 string, a const/var boolean, the type as an enumerated value and the expression as an 

expression tree. The expression of a name can be set by a call: 

eniun EiemenaryType {UnsignedlntegerT, IntegerT, 

DoubleT, VoltageT, ...}; 
Status setExpression(const String& name, 
1 0 const bool isConst, 

const elementary Type, 
const Expression& expression); 
[0143] The type Expression is a type that is a parsed form of the text corresponding to 

the right hand side of an assignment. There will be a globally available instance of 

1 5 UserVars. For example, the set of user variables in limits.usrv (cf. page) is implemented 

by the set of calls shown below: 

_UserVars.setExpression("MaxInteger", true, IntegerT, 

Expression(2 147483647)); 
_UserVars.setExpression("MinInteger", true, IntegerT, 
20 Expression(-2 147483648)); 

_UserVars.setExpression("Epsilon", true, DoubleT, 

Expression(2.2204460492503131e-016)); 
_UserVars.setExpression("MaxDouble", true, DoubleT, 

Expression(l .797693 1 348623 1 58e+308)); 
25 _UserVars.setExpression("MinDouble", true, DoubleT, 

Expression("- MaxDouble")); 
_UserVars.setBxpression("ZeroPlus", true, DoubleT, 

Expression(2.2250738585072014e-308)); 
_UserVars.setExpression("ZeroMinus", true, DoubleT, 
30 Expression("- ZeroPlus")); 

[0144] Below are the C++ statements that would be executed for the variables declared 

in myvars.usrv: 

myVars.setExpression("VInLow", true, VoltageT, 

Expression(O.O)); 

35 myVars.setExpression("VInHigh", true, VoltageT, 

Expression(5.0)); 
myVars.setExpression("DeltaT", true, TimeT, 

Expression(2.0E-9)); 
myVars.setExpression("ClkTick", true, TimeT, 
40 Expression(1.0E-9)); 

myVars.setExpression("R10", true, ResistanceT, 
Expression(10.0E+3)); 



wo 2005/114240 PCT/JP2005/009815 

43 

myVars.setExpressionC'ILow", false, CurrentT, 

Expression(l .OE-3)); 
myVars.setExpression("IHigh", false, CurrentT, 

Expression(2. OE-3 )) ; 
5 myVars.setExpressionC'PLow", false, PowerT, 

ExpressionC'ILow * VInLow")); 
myVars.setExpression("PHigh", false, PowerT, 

ExpressionC'IHigh * VInHigh")); 
myVars.setExpression("ABusVil[0]", false, VoltageT, 
10 Expression(l.O)); 

myVars.setExpression("ABusVil[l]", false, VoltageT, 

Expression(1.2)); 
myVars.setExpression("ABusVil[2]", false, VoltageT, 

Expression(1.5)); 

15 myVars.setExpression("ABusVil[3]", false, VoltageT, 

Expression(1.5)); 
myVars.setExpression("ABusVil[4]", false, VoltageT, 

Expression(1.5)); 
myVars.setExpression("ABusVil[5]", false, VoltageT, 
20 Expression(1.5)); 

myVars.setExpression("ABusVil[6]", false, VoltageT, 

Expression(1.5)); 
myVars.setExpression("ABusVil[7]", false, VoltageT, 

Expression(1.5)); 

25 [0145] In the code above, the Expression class preferably has constructors that 

represent the parsed form of the expression. Expression has several constructors, including 
one that takes a string literal and parses it, and another that takes a string literal to use just 
as a string literal. These are distinguished by additional parameters which are not specified 
above for the sake of readability. 

30 [0146] User variables in the default user variables collection will be managed by the 
UserVars object of class UserVars. User variables in a named user variables collection 
Xxx will be managed by a UserVars object named Xxx. 

Runtime API for UserVars 

[0147] The C++ UserVars class that contains these names and expressions exports an 
35 application programming interface (API) to evaluate and modify these values at runtime. 
Modification of the expressions associated v^th UserVars also addresses the issue of when 
the UserVars will be reevaluated, and what the impact of the evaluation will be. 
[0148] Consider first the issue of when the re-evaluation of UserVars as a result of a 
change should be triggered. If it is triggered immediately upon making a change to the 
40 expression, then the user would not be able to make a series of related changes prior to 
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triggering the re-evaluation. Consequently, re-evalutation is triggered by an explicit call 
by the user. 

[0149] The impact of reevaluation can be considered next. There are three kinds of re- 
evaluation that are available in accordance with the preferred embodiment: 
5 [0150] UserVars Collection Re-evaluation is re-evaluation limited to a single UserVars 
collection. The semantics of this operation is to re-evaluate all the variables of this 
collection once again. 

[0151] UserVars Targeted Re-evaluation is re-evaluation limited to a change to the 
expression bound to a single name. This would enable the user to change the expression of 
1 0 a single name, and cause the re-evaluation of the collection to take place, taking into 
consideration only this particular change. 

[0152] User Vars Global Re-evaluation is re-evaluation of all UserVars collections. 
This basically triggers a re-evaluation of all the UserVars collections in declaration order 
and is quite costly. 

1 5 [0153] All of the above re-evaluations will re-evaluate dependent objects such as 

Levels, Timings, etc. after re-evaluating the UserVars. Dependent objects will have a dirty 
bit that represents that it needs re-evaluation. Any time a UserVars collection is 
programmatically changed, it will also set the dirty bit on all dependent objects. This will 
trigger re-evaluation of the dependent objects. 

20 [0154] In summary, named UserVars collections help contain the re-evaluation impact 
problem. Re-evaluation is normally limited to a single collection. A simple way of using 
UserVars would be to only use the default UserVars collection. That way, the ripple effect 
of making a change can happen to all UserVars. This ripple effect can be limited by 
having several named UserVars collections. 

25 [0155] Multiple collections can refer to variables from one another, but the values 
bound to the variables are bound at time of use. No dependency is maintained between 
UserVars collections. 

[0156] For each elementary type Xxx {Unsignedlnteger, Current, Voltage, etc.), a 
method to get the value: 
30 Status getXxxValue(const String& name, Xxx& value) const; 

Note that there is no method to directly set a value, it is done through the call to set the 
expression, followed by a call to reevaluateCollection(). 
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[0157] Methods to get and set the expression. The setExpressionQ call can also be 

used to define a new variable which was not hitherto defined. 

enum elementaryType 
{ 

5 UnsignedlntegerT, IntegerT, DoubleT, VoltageT, ... 

}; 

Status getExpression(const String& name, 

Expression& expression) const; 
Status setExpression(const String& name, 
10 const bool isConst, 

const elementaryType, 
const Expression& expression); 
[0158] The setExpressionQ call can fail if the expression results in a circular 

dependency. For instance if the following two calls were made, the second call would fail 

1 5 with a circular dependency failure 

setExpression("X", true, IntegerT, Expression("Y+l ")); 
setExpression("Y", true, IntegerT, Expression("X+r')); 
This is because the values bound to names are equations and are not assignments. When 

the value of a variable is changed, a method is provided to re-evaluate all the directly and 

20 indirectly dependent names. Equations such as the above pair result in a circular 

dependency which is not permitted. 

[0159] Note that this API does not typically support unsolicited re-evaluation. A call 
to setExpressionQ may not automatically cause the variable, and all other variables that 
depend on it, to be re-evaluated. The values bovmd to all variables will stay unchanged 
25 until a call to reevaluateCoUectionQ (below) occurs. 

[0160] A method to determine if a particular name is a constant: 

Status getIsConst(const String& name, bool& isConst); 

[0161] A method to get the type: 

enum ElementaryType 
30 { 

UnsignedlntegerT, IntegerT, DoubleT, VoltageT, ... 

}; 

Status getType(const String& name, 

ElementaryType& elementaryType) const; 
35 [0162] The UserVars Collection Re-evaluation method. 

Status reevaluateCoUectionQ; 

[0163] The class will maintain equations related to all the variables, and their 
dependencies. When this method is called, all of the variables will get re-evaluated. 
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[0164] The UserVars Targeted Re-evaluation method. 

Status reevaluateTargeted(const Strmg& var); 

[0165] The class will maintain equations related to all the variables, and their 
dependencies. When this method is called, the named variable, and all of its dependents 
5 will get re-evaluated. 

The UserVars Global Re-evaluation method. 

static Status reeva]uateAllCollections(); 

[0166] The class will maintain equations related to all the variables, and their 
dependencies. When this method is called, reevaluateCollectionQ is called on all UserVars 
1 0 collections in an unspecified order. 

[0167] A method to determine if a particular name is defined: 

Status getIsDefmed(const String& name, bool& isDefmed) const; 

[0168] A method to determine all the user variables currently defined: 
Status getNames(StringList& names) const; 

1 5 [0169] A method to delete a presently defined variable: 

Status deleteName(const String& name); 

[0170] This operation will fail if the name is used in expressions involving other 
variables. 

A method to get the list of variables and constants that depend on a given variable or 
20 constant: 

Status getDependents(const String& name, StringList& dependents); 

Specification Sets 

[0171] The Specification Set is used to supply a collection of variables which can take 
on values based on a Selector. For example, consider the following Specification Set that 
25 uses selectors Minnie, Mickey, Goofy and Daisy: 

# . 

# File Aaa.spec 



# 

30 Version 1.0; 

Import Limits.usrv; 
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SpecificationSet Aaa(Minnie, Mickey, Goofy, Daisy) 
{ 

Double XXX = 1.0, 2.0, 3.0, 4.0; 
Integer yyy = 10, 20, 30, 40; 
5 Integer zzz = Maxinteger - xxx, 

Maxinteger - xxx - 1 , 

Maxinteger - xxx - 2, 

Maxinteger - xxx; 

10 # The following declaration associates a single 

# value, which will be chosen regardless of the 

# selector. It is equivalent to: 

# Integer www = yyy + zzz, yyy + zzz, yyy + zzz, yyy + zzz 
Integer www = yyy + zzz; 

15 } 

[0172] The above Specification Set with the selector Goofy will make the following 

associations: 

xxx = 3.0; 
yyy = 30; 

20 zzz = Maxinteger - xxx - 2; 

www = yyy + zzz; 

[0173] The operation of setting the selector on a specification set will be discussed 
later, when Tests are described. 

[0174] Syntactically, a specification set a is list of selectors (Minnie, Mickey, Goofy 
25 and Daisy in the example above), along with a list of variable definitions (xxx, yyy, zzz 

and www in the example above). The definition of a variable involves a list of expressions 
that is either as long as the list of selectors, or comprises a single expression. 
[0175] Conceptually a specification set can be thought of as a matrix of expressions, 
whose columns are the Selectors, whose rows are the variables and whose entries are 
30 expressions. A particular selector (column) binds each variable (row) to a specific 
expression (entry). If the list has a single expression, it represents a row with the 
expression replicated as many times as there are selectors. 
[0176] Specification sets can appear in two separate contexts. They could be 
separately declared in a .spec file, in which case they appear as shown above. These are 
35 named specification sets. Otherwise, local specification sets can be declared within a Test 
Condition Group. In such a declaration, the specification set will not be provided with a 
name. It will be a local specification set, of significance only to the enclosing test 
condition group. 
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[0177] Named specification sets can be modeled after the named user variables 
collection. The above specification set can be modeled as a UserVars collection named 
Aaa, which will have expressions for xxx[Minnie], xxx[Mickey], xxx[Gooly], xxx[Daisy], ■ 
yyy[Minnie], and so on. When a particular selector (say Mickey) is chosen in the context 
5 of a test, the values of xxx, yyy and zzz are obtained from the variable name and the 
specification set name. 

[0178] A test condition group can have at most one specification set, which is either a 
local specification set, or a reference to a named specification set. Local specification sets 
appear only in the context of a test condition group, and have no explicitly specified name. 
1 0 Such a specification set has an implicit name that is defined by the name of the enclosing 
test condition group. To resolve a name in a test condition group at a point where several 
specification sets and several UserVars collections are visible, the following rules are 
applied: 

1 . If the name is qualified, it must be resolved in a named user variables 
1 5 collection. 

2. If the name is not qualified, the name is resolved in either a local 
specification set, if it is declared in the test condition group, or in the named 
specification set, if one is referenced in the test condition group. 

3. If the name is not resolved by the earlier rules, it is resolved in the default 
20 user variables collection. 

[0179] To illustrate these rules, consider the folio v^dng example using Test Conditions 
Groups (to be described later) 

Version 1.2.3; 

Import limits.usrv; # Picks up the limits UserVars file above. 
25 Import aaa.spec; # Picks up the Specification Set AAA above. 

TestConditionGroup TCGl 
{ 

SpecificationSet(Min, Max, Typ) 
30 { 

vcc = 4.9, 5.1,5.0; 

} 

# Rule 1 : Resolution in a named user variables collection. 

35 # A reference to MyVars.VInLow refers to VInLow from MyVars. 

# Rule 2: Resolution in a local specification set. 

# A reference to "vcc" here will resolve in the context 
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# of the local specification set above. 

# Rule 3: Resolution in default user variables collection. 

# A reference to "Maxinteger" here will resolve to limits. usrv. 

5 

# Error: Resolution of xxx 

# A reference to xxx does not resolve because it is neither in 

# the local specification set, nor in limits.usrv. 

1 0 # Error: Resolution of Aaa.xxx 

# Looks for a named UserVars collection named Aaa. The named 

# specification set does not qualify. 

} 

15 

TestConditionGroup TCG2 
{ 



20 



25 



30 



35 

} 

[0180] Resolution of a name in a specification set (rule above) requires that a selector 
of the set be enabled at the time the name resolution is required. This will be enforced by 
40 the fact that the test condition group will be referenced in a Test by specifying a selector. 

C++ for Specification Sets 

[0181] Using the above rules. Specification sets can be implemented by the C++ 
SpecificationSet class. The SpecificationSet class has essentially the same API as the 
UserVars class, except for an extra String parameter for the selector. Consequently, this 
45 API is not described in detail. 



SpecificationSet Aaa; # References the imported specification set 

# Rule 1 : Resolution in a named user variables collection. 

# A reference to MyVars.VInLow refers to VInLow from MyVars. 

# Rule 2: Resolution in a named specification set. 

# A reference to "xxx" here will resolve in the context 

# of the local specification set Aaa above. 

# Rule 3: Resolution in default user variables collection. 

# A reference to "Maxinteger" here will resolve to limits.usrv. 

# Error: Resolution of vcc 

# A reference to vcc does not resolve because it is neither in 

# the named specification set Aaa, nor in limits.usrv. 

# Error: Resolution of Aaa.xxx 

# Looks for a named UserVars collection named Aaa. The named 

# specification set does not qualify. 
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[0182] All named specification sets are preferably associated with a C++ object of that 
name. A local specification set in the context of a test condition group will have a name 
that is unique to that test condition group. It is illegal to refer to a variable of a local 
specification set outside the context of the test condition group that it is defined in. 

5 Levels 

[0183] The Levels are used to specify parameters of pins and pin groups. It is a 
collection of declarations of the form: 

<pin-or-pin-group-name> 
{ 

1 0 <pin-param- 1 > = xxx; 

<pin-param-2> = yyy; 

} 

[0184] Such a declaration specifies the setting of the various parameters of the named 
1 5 pin or pin-group. For example, such a statement could be used to set the VIL values for all 
pins in the InputPins group, as shown in the example below: 



# 

# File CHIPlevels.lvl 
20 # 



Version 1.0; 

Import CHIPSresources.rsc; 
25 Import CHIPSpins.pin; 

Levels CHIP3Levels 
{ 

# 

30 # Specifies pin-parameters for various pins and 

# pin groups using globals and values from 

# the specification set. 

# The order of specification is significant. 
35 # Pin parameters will be set in order from 

# first to last in this Levels section, and 

# from first to last for each pin or pin-group 

# subsection. 
# 

40 # From the imported pin description file CHlP3pins.pin, 

# the InPins group is in the "dpin" resource. From the 

# imported resource definition file CHIP3resources.rsc, 

# the "dps" resource has parameters named VIL and VIH. 
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# 

InPins { VIL = v_il; VIH = v_ih + 1 .0; } 

# The following statement requires a delay of 10 uS after 

# the call to set the InPins levels. Actual delay will be 

# a small system defined range around lO.OE-6: 

# 1 0.OE-6 - delta <= actual <= 1 0.OE-6 + delta 
Delay lO.OE-6; 

# 

# For the OutPins, the levels for the parameters 

# VOL and VOH are specified. 
# 

OutPins { VOL = v_ol / 2.0; VOH = v_oh; } 

# The clock pin will have special values. 
Clock { VOL = 0.0; VOH = v_ih / 2.0; } 

# A Delay of 10 uS after the call to set Clock levels. 

# This is a minimum delay, that is guaranteed to be for 

# at least 10.0 uS, though it may be a little more: 

# 1 0.OE-6 <= actual <= 1 0.OE-6 + delta 
MinDelay 10.0 uS; 

# 

# The PowerPins group is in the "dps" resource. Pins of this 

# pin group have special parameters: 

# PRE_WAIT specifies the time to wait after voltage 

# reached its final value to start pattern 

# generation. Actual wait time will be a small 

# system defined range around PRE_WAIT (see) 

# POST_WAIT specifies the time to wait after pattern 

# generation ends to shut down the power. Actual 

# wait time will be a small system defined range 

# around PRE_WAIT (see). 
# 

PowerPins 
{ 

PRE_WAIT=10.0 ms; 
POST_WAIT= 10.0 ms; 

# VCC reaches its final value of 2.0 V from its 

# present value in a ramp with a Voltage Slew Rate 

# of ±.01 Volts per Second. 
VCC = Slew(0.0 1,2.0 V); 

} 
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Levels CHIP4Levels 
{ 

#... 

5 } 

[0185] As seen above, each Levels block is preferably made up of a number of levels 

items, each of which specifies parameters for a pin or pin group. Each levels item can 

specify a number of resource parameters. The runtime semantics for the setting of these 

levels values is as follows: 

10 [0186] The levels items of the Levels block are processed in declaration order. Any 

pin that occurs in more than one levels item will get processed multiple numbers of times. 

Multiple specification of values for a single parameter should be maintained and applied in 

specification order. 

[0187] The resource parameters in a levels item are processed in the order they are 
15 specified. 

[0188] The Delay statements cause the process of setting levels to pause for 
approximately the indicated duration, prior to setting the next group of levels. The actual 
wait time may be in a small system defined range around the specified delay. So if the 
delay was t seconds, the actual delay would satisfy: 
20 t - At <= actual-wait <= t + At 

[0189] The Delay statements divide up the Levels specification into a number of 
subsequences, each of which will require separate Test Condition Memory settings for 
processing. 

[0190] The MinDelay statements cause the process of setting levels to pause for at 
25 least the specified duration prior to setting the next group of levels. The actual wait time 

may be in a small system defined range with a minimum value of the specified minimum 
delay. So if the minimum delay was t seconds, the actual delay would satisfy: 

t <= actual-wait <= t + At 
[0191] The MinDelay statements divide up the Levels specification into a number of 
30 subsequences, each of which will require separate Test Condition Memory settings for 
processing. 

[0192] Each pin or pin-group name is specified in exactly one resource in a pin 
description file (suffix .pin), and therefore has a certain set of viable resource parameters 
specified in the resource file (suffix .rsc). All the parameters named must be from among 
35 this set of viable resource parameters, and must be of the same elementary type as the 
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expression used to set their value. Information about the names and types of resource 
parameters comes from the resource file. 

[0193] The resource file Resources. rsc is implicitly imported, providing tester with the ' 
names and types for parameters of standard resources such as dpin, and dps. 
5 [0194] Resource parameters are assigned expressions that can use UserVars, and 
values from named specification sets or a currently visible local specification set. 
[0195] Dps pin resources have special parameters PRE WAIT and POST_WAIT. The 
PRE_WAIT parameter specifies the time that needs to elapse from the time the power pin 
has reached its destination voltage to the time pattern generation can start. The 
1 0 POST_WAIT parameter specifies the time that needs to elapse from the time pattern 
generation has stopped to the time the power pin shuts off. 

[0196] Dps pins also specify how the voltage parameter reaches its final value. They 
could specify it simply by an equation, as all other pin parameters. In that case the value 
will be reached as the hardware allows it. They could also specify it using a Slew 
15 statement. A Slew statement specifies that the power supply voltage reaches its final value 
from the initial value in a ramp with a specified absolute Voltage Slew Rate. 

C++ for Levels 

[0197] With above rules, a C++ Levels object can be written that supports the 
following operations: 
20 There is an operation 

Status setPararaeter(const String& pinOrPinGroupName, 
const String& parameterName, 
ElementaryType elementary Type, 
const Expression& Expression); 
25 [0198] This operation binds an expression to a parameter of a pin or a pin group. For 

instance, the dpin.lnPins VIH value is set by: 

setParameterC'lnPins", "VIH", VoltageT, 
Expression("v_ih + 1.0"); 
[0199] This operation will be called several times for all the declarations in the Levels 

30 object. 

There is an operation 

Status assignLevels(const String& selector); 
which will go through and issue all the pre-determined module level interfaces 
to assign all the levels of parameters in specification order, as described earlier. 
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The selector parameter is used to resolve names in the expressions according to 
the rules specified earlier. 

Test Condition Groups 

[0200] The Test Condition Group Sub-language packages together the description of 
5 specifications, timings and levels. Timing objects are often specified using parameters. 
Parameters can be used in timings to specify leading and trailing edges of various pulses. 
Likewise, Levels can be parameterized by specifying maximum, minimum and typical 
values of various voltage levels. A Test Condition Group {TCG) object lumps together the 
specifications and the instantiation of Timings and Levels based on these specifications. 

10 [0201] A TestConditionGroup declaration contains an optional SpecificationSet. The 
SpecificationSet declaration may be an inlined (and unnamed) local SpecificationSet, or it 
may be a reference to a named SpecificationSet declared elsewhere. The optional 
SpecificationSet declaration in a TCG declaration is followed by at least one Levels or 
Timings declaration. It can have both Levels and a Timings, in any order. However, it is 

15 disallowed fi"ora having more than one Levels and Timings declaration. These restrictions 
are syntactically enforced. 

[0202] A specification set declaration in a TCG is identical to the specification set 
declared separately, except that it does not have a name. Its name is implicitly the name of 
the enclosing TCG. The Timings declaration comprises a single declaration of a Timings 
20 object from a specified timings file. Here is an example of a file with a test condition 
group: 

# 

# File myTestConditionGroups.tcg 

# 

25 

Version 0.1; 

Import CHIPlevels.lvl; 
Import edges.spec; 
30 Import timingl .tim; 

Import timing2.tim; 

TestConditionGroup TCGl 
{ 

35 # This Local SpecificationSet uses user-defined selectors 

# "min", "max" and "typ". Any number of selectors with any 

# user defined names is allowed. 
# 
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# The specification set specifies a table giving values for 

# variables that can be used in expressions to initialize 

# timings and levels. The specification set below defines 

# values for variables as per the following table: 
5 # min max typ 

# vcc 2.9 • 3.1 3.0 

# v_ih vInHigh + 0.0 vInHigh + 0.2 vInHigh + 0. 1 

# v_il vInLow + 0.0 vInLow + 0.2 vInLow + 0.1 

# ... 

10 # A reference such as "vInHigh" must be previously defined 

# in a block of UserVars. 
# 

# Thus, if the "max" selector was selected in a functional 

# test, then the "max" column of values would be bound to 
15 # the variables, setting v_cc to 3. 1 , v_ih to vInHigh+2.0 

# and so on. 
# 

# Note that this is a local specification set, and has no 

# name. 

20 Specification Set(min, max, typ) 

{ 

# Minimum, Maximum and Typical specifications for 

# voltages. 

Voltage v_cc = 2.9, 3.1, 3.0; 
25 Voltage v_ih = vInHigh + 0.0, 

vInHigh + 0.2, 

vInHigh + 0.1; 
Voltage v_il = vInLow + 0.0, 

vInLow + 0.2, 

30 vInLow + 0.1; 

# Minimum, Maximum and Typical specifications for 

# leading and trailing timing edges. The base 

# value of 1 .OE-6 uS corresponds to 1 picosecond, 
35 # and is given as an example of using scientific 

# notation for numbers along with units. 
Timet_le= 1.0E-6uS, 

l.OE-6 uS + 4.0 * DeltaT, 
1.0E-6uS + 2.0*DeltaT; 
40 Time t_te = 30ns, 

30ns + 4.0 * DehaT, 
30ns + 2.0 * DeltaT; 

} 

45 # Refers to the GHIP3LeveIs imported earlier. It 

# is one of possibly many levels objects that have been 

# imported fi-om the above file. 
Levels CHIP3Levels; 



wo 2005/114240 



PCT/JP2005/009815 



} 



56 

# Refers to file timing l.tim containing the single 

# timing Timingl. The filename should be quoted if 

# it has whitespace characters in it. 
Timings Timingl; 



# Another test condition group 
TestConditionGroup TCG2 
{ 

10 # ClockAndDataEdgesSpecs is a specification set which 

# is available in the edges.specs file. Assume it has 

# the following declaration: 

# SpecificationSet ClockAndDataEdgesSpecs(min, max, typ) 

# { 

15 # Time clockje = 10.00 uS, 10.02 uS, 10.01 uS; 

# Time clock te = 20.00 uS, 20.02 uS, 20.01 uS; * . 

# Time dataje = 10.0 uS, 10.2 uS, 10.1 uS; 

# Time data_te = 30.0 uS, 30.2 uS, 30. 1 uS; 

# } 

20 # A SpecificationSet reference to this named set is below: 

SpecificationSet ClockAndDataEdgesSpecs; 

# An inlined levels declaration. Since the associated 

# specification set (above) does not have variables such 

25 # as VInLow, VInHigh, VOutLow and VOutHigh, they must 

# resolve in the default UserVars collection. 
Levels 

{ 

InPins { VIL = VInLow; VIH = VInHigh + 1 .0; } 
30 OutPins' { VOL = VOutLow / 2.0; VOH = VOutHigh; } 

} 

# This Timing is from the file "timing2.tim". The timings 

# will need the leading and trailing edge timings for clock 
35 # and data as specified in the above specification set. 

Timings Timing2; 

} 

[0203] In the above example, the test condition group TCGl describes a specification 
set with three selectors named "min", "typ" and "max". There can be any number of 

40 distinct selectors. Within the body of the specification set, variables v_il, v_ih, t_le and 
t_te are initialized with triples of values, corresponding to the selectors. So in the above 
example, an instance of TCGl with the selector "min" will bind the variable v_il with the 
first numeric value, (vInputLow+0.0). It bears repetition that the selectors for a 
specification set are user defined, and any number of them is allowed. The only 

45 requirement is that: 
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[0204] The selectors of a specification set be unique identifiers. 
[0205] Each value specified in the specification set is associated with an array of 
values that exactly the same number of elements as the set of selectors. Picking the /"^ 
selector will cause each value to be bound to the value of its associated vector of values, 
5 [0206] Subsequent to the specification set in the TCG, there could be a Levels 

declaration or a Timings declaration or both. The Levels declaration is used to set levels 
for various pin parameters. The variables identified in the specification set will be used to 
set these levels, permitting a dynamic binding of different actual values for pin parameters 
based on the selector used to initialize the TCG. 

1 0 [0207] To exemplify this, consider a Test that enables the selector "min". Referring to 
the specification set CHIP3Levels given on page, the pin parameter "VIH" for pins in the 
InPins group will be initialized to the expression (v_ih + 1 .0) by the declaration: 

InPins { VIL = vjl; VIH = v_ih + 1 .0; } 
[0208] This resolves to (VlnHigh + 0.0+1 .0) when the selector "min" is enabled. 

1 5 Likewise, the Timings object can be initialized based on the selected values of the 
specification set variables. It is not necessary to have both a Timings and a Levels 
declaration. Either can be present by itself, or both in any order, as illustrated by the 
following example: 

# 

20 # File LevelsOnlyAndTimingsOnly.tcg 



# 

Version 0.1; 

25 # A Levels-only Test Condition Group. 

TestConditionGroup LevelsOnlyTCG 
{ 

SpecificatioDSet(Min, Max, Typ) 
{ 

30 Voltage v il = 0.0, 0.2, 0. 1 ; 

Voltage vjh = 3.9, 4.1, 4.0; 

} 

# An inlined levels declaration. Since the associated 
35 # specification set (above) does not have variables such 

# as VInLow, VlnHigh, VOutLow and VOutHigh, they must 

# resolve in the default UserVars collection. 
Levels 

{ 

40 InPins { VIL = v_il; VIH = v_ih + 1 .0; } 
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OutPins { VOL = v_il / 2.0; VOH = v_ih; } 



# A Timings-only Test Condition Group 
TestConditionGroup TimingsOnlyTCG 
{ 

SpccificationSet(Min, Max, Typ) 



Time t_le = 0.9E-3, l.lE-3, l.OE-3; 



} 



Timings Timing2; 



[0209] Note, however, there should not be more than one Timings and more than one 
Levels in a TCG. Thus, in summary, there should be at least one of Timings or Levels, 
and at most one of each. 



Test Conditions 

[0210] A TestCondition object ties a TCG to a specific Selector. Once a TCG has been 
declared as shown above, it is possible to declare TestCondition objects as shown below: 
TestCondition TCMin 



TestConditionGroup = TCGl; 
Selector = min; 



TestCondition TCTyp 

TestConditionGroup = TCGl; 
Selector = typ; 



TestCondition TCMax 

TestConditionGroup = TCGl; 
Selector ~ max; 



[0211] These Test Conditions would be instantiated in a Test Plan as follows: 
# 

# Declare a FunctionalTest "MyFunctionalTest" that refers to three 

# Test Condition Group instances. 
# 

Test FunctionalTest MyFunctionalTest 
{ 
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# Specify the Pattern List 
PList = patlAlist; 

# Any number of TestConditions can be specified: 
TestCondition = TCMin; 

TestCondition = TCMax; 
TestCondition = TCTyp; 

} 

Name Resolution In TCGs (test condition groups) 

[0212] Resolution of names in a test condition group was discussed earlier. However, 

these rules bear repetition, and are given below again: 

1 . If the name is qualified (cf. page), it must be resolved in a named user 

variables collection. 

2. If the name is not qualified, the name is resolved in either a local 
specification set, if it is declared in the test condition group, or in the 
named specification set, if one is referenced in the test condition group. 

3. If the name is not resolved by the earlier rules, it is resolved in the 
default user variables collection. 

TCG Runtime 

[0213] Test condition groups have the following runtime semantics: 

[0214] A Test (such as a FunctionalTest) will reference a TCG with a particular 

selector from its SpecificationSet, using an instantiated TestCondition. This selector will 

bind each variable in the SpecificationSet to its value associated with the chosen selector. 

This binding of variables to their values will then be used to determine Levels and Timings. 

Parameter Levels in a TestConditionGroup are preferably set sequentially, in the order of 

presentation in the Levels block. So in the CHIP3Levels block, the order in which 

parameter levels would be set is as> follows (notation: <resource-name>.<resource- 

parameter>): 

InputPins.VIL, 

InputPins.VIH, 

OutputPins.VIL, 

OutputPins.VIH, 

Clock.VOL, 

Clock.VOH. 
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[0215] This sequencing order enables the test writer to control the explicit power 
sequencing of power supplies. Furthermore, if a levels item occurs twice, naming the same 
pin-parameters for a pin, then that pin-parameter gets set twice. This can happen 
programmatically also. 
5 [0216] If a parameter is set by a Slew statement such as 

VCC = Slew(0.01,2.0V); 
it means that VCC will reach its final value of 2.0 volts from its present value in a ramp 
with a Voltage Slew Rate of ± 0.01 volts per second. 

[0217] Specification set variables can also be passed into a Timings object in the TCG. 
10 The Timings object will then be initialized based on the selected variables. Such a 

mechanism could be used to customize a Timings object, as, for instance, by specifying 
leading and trailing edges of v^veforms. 

C++ for TCGs 

[0218] With the above rules, the Test Condition Group can be declared in a C++ 
1 5 TestConditionGroup class, and initializing it as follows: 

[0219] A call is made to the TestConditionGrroup member function 

Status setSpecificationSet(SpecificationSet *pSpecificationSet); 

which will set the specification set for the TestConditionGroup. This may either be a local 

specification set, or a named specification set, or null (if there is none). 
20 [0220] A call is made to the TestConditionGroup member fiinction 

Status setLevels(Levels *pLevels); 

which will set the Levels object for the TestConditionGroup. This may either be a locally 

declared levels object, or an externally declared levels object, or hull (if there is none). 

[0221] A call is made to the TestConditionGroup member function 
25 Status setTimings(Timings *pTimings); 

which will set the Timings object for the TestConditionGroup. This will be either an 

externally declared Timings object, or null (if there is none). 

Bin Definitions 

[0222] The Bin Definitions class defines bins, a collection of counters that summarize 
30 the results of testing many DUTs. During the course of testing a DUT, the DUT can be set 
to any bin, e.g., to indicate the result of a particular test. As testing proceeds, the DUT 
may be set to another bin. The bin that the DUT is finally set to is the last such setting at 
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the end of the test. The counter for this final bin is incremented at the end of the test of this 
DUT. A separate file with bin definitions should have the suffix .bdefs. 
[0223] Bin definitions are preferably hierarchical. For example, at an outermost level, 
there may be the PassFailBins with two bins named Pass and Fail. Then there could be 
5 several HardBins, some of which map to the Pass bin, and others which map to the Fail bin. 
The HardBins are said to be a refinement of the PassFailBins. Finally, there could be a 
large number of SoftBins, a refinement of HardBins, many of which map to the same Hard 
bin. Below is an example illustrating the hierarchy of bins: 

# - 

10 # File CHIPbins.bdefs 

# 

Version 1.2.3; 

IS BinDefs 

{ 

# The HardBins are an outermost level of 

# bins. They are not a refinement of any other 

# bins. 

20 BinGroup HardBins 

{ 

"3GHzPass": "DUTs passing 3GHz"; 
"2.8GHzPass": "DUTs passing 2.8GHz"; 
"3GHzFaii": "DUTs failing 3GHz"; 
25 "2.8GHzFail": "DUTs failing 2.8GHz"; 

LeakageFail: "DUTs failing leakage"; 

} 

# The SoftBins are a next level of refinement. 
30 # SoftBins are a refinement of HardBins. 

BinGroup SoftBins : HardBins 
{ 

"3GHzAllPass": 

"Good DUTs at 3GHz", "3GHzPass"; 
35 "3GHzCacheFail": 

"Cache Fails at 3GHz", "3GHzFail"; 
"SGHzSBFTFail": 

"SBFT Fails at 3GHz", "3GHzFail"; 
"3GHzLeakage": 

40 "Leakages at 3GHz", LeakageFail; 

"2.8GHzAllPass": 

"Good DUTs at 2.8GHz","2.8GHzPass"; 
"2.8GHzCacheFail": 

"Cache Fails at 2.8GHz","2.8GHzFaii"; 
45 "2.8GHzSBFTFair': 
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"SBFT Fails at 2.8GHz", "Z.SGHzFail"; 
"2.8GHzLeakage": 

"Leakages at 2.8GHz", LeakageFail; 

} 

5 } 

[0224] In the above example, the most base bins are the BinGroup HardBins. A 

BinGroup X is said to be a group of base bins if some other BinGroup is a refinement of X. 

Thus, the BinGroup HardBins is a group of base bins since the BinGroup SoftBins is a 

refinement of HardBins. The bins, of SoftBins are referred to as leaf bins. A BinGroup Y 

1 0 is said to be a group of leaf bins if no other BinGroup is a refinement of Y. 

[0225] The degenerate case of a BinDefs block with a single BinGroup Z in it will 
have Z to be a group of most base bins, as well as a group of leaf bins. BinGroup names 
are global in scope. There can be any number of BinDefs blocks, but the declared 
BinGroups must be distinct. A BinGroup from one BinDefs block is allowed to be a 

15 refinement of a BinGroup fi-om another BinDefs block. So in the above example, SoftBins 
could be in a separate BinDefs block from HardBins. However, it is strongly 
recommended to have a single BinDefs block with all the BinGroups defined for the sake 
of readability. 

[0226] The above hierarchy can now be extended to count how many DUTs passed 
20 and failed, by adding another BinGroup. 



# 

# File CHIPbins.bdefs 

# • 



25 Version 1.2.3; 

BinDefs 

{ 

# The PassFailBins are an outermost level of 
30 # bins. They are not a refinement of any other 

# bins. 

BinGroup PassFailBins 
{ 

Pass: "Count of passing DUTS."; 
35 Fail: "Count of failing DUTS."; 

} 

# The HardBins are a next level of refinement. 

# HardBins are a refinement of the PassFailBins, 
40 # as indicated by "HardBins : PassFailBins". 

BinGroup HardBins : PassFailBins 
{ 
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"3GHzPass": "DUTs passing 3GHz", Pass; 
"2.8GHzPass": "DUTs passing 2.8GHz", Pass; 
"BGHzFaii": "DUTs failing 3GHz", Fail; 
"2.8GHzFair: "DUTs failing 2.8GHz", Fail; 
5 LeakageFail: "DUTs failing leakage", Fail; 

} 

# The SoflBins are a next level of refinement. 

# SoftBins are a refinement of HardBins. 
10 BinGroup SoftBins : HardBins 

{ 

"3GHzAllPass": 

"Good DUTs at 3GHz", "3GHzPass"; 
"3GHzCacheFail": 
1 5 "Cache Fails at 3GHz", "3GHzFail"; 

"3GHzSBFTFail": 

"SBFT Fails at 3GHz", "3GHzFail"; 
"3GHzLeakage": 

"Leakages at 3GHz", LeakageFail; 
20 "2,8GHzAllPass": 

"Good DUTs at 2.8GHz","2.8GHzPass"; 
"2.8GHzCacheFail": 

"Cache Fails at 2.8GHz","2.8GHzFail"; 
"2.8GHzSBFTFail": 
25 "SBFT Fails at 2.8GHz", "2.8GHzFail"; 

"2.8GHzLeakage": 

"Leakages at 2.8GHz", LeakageFail; 

} 

} 

30 [0227| This time, the most base bins are the BinGroup PassFailBins. They are 

typically not a refinement of any bins. The BinGroup HardBins are a refinement of the 
PassFailBins and are also base bins. SoftBins are a refinement of the HardBins, and are a 
group of leaf bins. The above example had only three BinGroups in the hierarchy. Below 
is a more complicated hierarchy: 

3S BinDefs 

{ 

# A group of most base bins 
BinGroup A { ... } 

40 # A group of base bins that is a refinement of A 

BinGroup Ax : A { ... } 



45 



# A group of leaf bins that is a refinement of Ax 
BinGroup Axx : Ax { ... } 

# A group of base bins that is a refinement of A 



wo 2005/114240 PCT/JP2005/009815 

64 

BiflGroup Ay : A { ...} 

# A group of leaf bins that is a refinement of Ay 
BinGroup Ayy : Ay { ... } 

5 

U A group of most base bins 
BinGroup B { ... } 

# A group of leaf bins that is a refinement of B 
10 BinGroup Bx : B {... } 

} 

[0228] In this example, Ax and Ay are refinements of A, Axx is a refinement of Ax 
and Ayy is a refinement of Ay. This example also provides BinGroups B and Bx where 
Bx is a refinement of B. The BinDefs declaration above with the BinGroups named 

1 5 PassFailBins, HardBins and SoftBins will be used as a continuing example in this section. 
[0229] Each bin in a BinGroup has: 

1 . a name which is either an identifier or a string literal 

2. a description which describes what this bin summarizes 

3. and if this bin is in a refinement BinGroup, the name of the bin it is a 
20 refinement of, also known as the base bin. 

[0230] The two bins in PassFailBins are named "Pass" and "Fail". The five bins in 
HardBins are named "BGHzPass", "2.8GHzPass", "SGHzFail", "2.8GHzFail", 
"LeakageFail". Bin names may be a literal string, or an identifier. Bin names must be 
unique in a BinGrroup, but may be duplicated across BinGroups. BinGroup names, 
25 however, are global in scope, and must be unique across a test plan. 

[0231] Of the five HardBins, the bins "3GHzPass" and "2.8GHzPass" both map to the 
"Pass" bin of the PassFailBins. The rest of the HardBins map to the "Fail" bins of the 
PassFailBins. 

[0232] Finally, there are eight SoftBins. The two failures at 3GHz for SBFT (soft bin 
30 fiinctional test) and Cache map to the "SGHzFail" HardBin, Likewise the two failures at 
2.8GHz for SBFT and Cache map to the "2.8GHzFair' HardBin. Both the failures due to 
Leakage map to the same "LeakageFail" HardBin, regardless of the speed at which they 
occurred. For example, the coarsest test (at the outermost level) is whether a DUT passes 
or fails a test. A refinement is, for example, whether the DUT passes or fails a test at a 
35 particular frequency, e.g., 3 GHz, etc. 

[0233] Bins are assigned to DUTs in a Test Plan Flowltem, described below. A 
TestPlan Flowltem has a Result Clause in which the test plan describes the actions and 
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transition to take place as the result of getting a particular result back from executing a test. 

It is at this point that a SetBin statement can occur: 

# A Flowltem Result clause. It is described later. 
Result 0 
5 { 

# Action to be taken on getting a 0 back from 

# executing a test. 

# Set the bin to SoftBin."3GHZPass" expressing that the 
10 # DUT was excellent. 

SetBin SoftBins."3GHzPass"; 

} 

[0234] Many SetBin statements could execute during the course of running a test on a 

DUT. When the test is finally completed, the runtime will increment counters for the final 

1 5 bin that is set for that DUT, and for all its refinements. Consider a DUT which had the 

following SetBin statements executed during the course of its test: 

SetBin SoftBins."3GHzSBFTFail"; 
SetBin SoflBins."2.8GHzAllPass"; 

20 [0235] This DUT passed the 3GHz Cache and Leakage tests, but failed the SBFT test, 
and so was assigned to the "3GHzSBFTFail" bin. It was then tested at 2.8GHz, and all the 
tests passed. So the final bin assigiunent is to the "2.8GHzAllPass" bin, which is in the set 
of SoftBins. This final assigiunent will increment the counters of the following bins: 
1. SoftBins."2.8GHzAllPass" 

25 2. which is a refinement of HardBins."2.8GhzPass" 

3. which is a refinement of PassFailBins."Pass" 

[0236] When the test completes, runtime will increment the cbunter of the final bin 
assignment of the DUT, and for all other bins it is a refinement of 
[0237] A SetBin statement is allowed only on a leaf bin. It is illegal to set a base bin. 
30 The counter incrementing semantics above assures that: 

1 . If the bin is a leaf bin, it is the number of times a SetBin statement 
was executed for this bin at the end of testing a DUT. 

2. If the bin is a base bin, it is the simi of the counters of the bins that it 
is a refinement of 

35 [0238] Thus, in the above example, only SoftBins are allowed in a SetBin statement. 
The counter for HardBins."LeakageFail" is the sum of the counters for 
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SoftBins."3GHzLeakageFail" and SoftBins."2.8GHzLeakageFail". Below are some rules 
regarding bin definitions: 

1 . A BinDefinitions declaration is comprised of several BinGroup 
declarations. 

2. Each BinGroup declaration has a name, an optional BinGroup name 
that it is a refinement of, followed by a block of bin declarations. 

3. Bin declarations comprise a name, followed by a description, 
optionally followed by the name of a base bin that this bin is a 
refinement of. 

4. Bin names can be a string literal, or an Id. The empty string should 
not be a valid bin name. Bin names should be unique among names 
in the BinGroup declaration, but the same name could be used in 
other BinGroup declarations. 

5. If a BinGroup declaration Xxx is a refinement of another BinGroup 
declaration Yyy, then all of the bin declarations in Xxx must declare 
the name of a base bin from Yyy. Thus, each of the bin declarations 
in SoflBins is a refinement of a bin of HardBins, since the SoftBins 
are declared to be a refinement of HardBins. 

6. A BinGroup declaration that is not a refinement of another 
BinGroup declaration, such as PassFailBins will preferably have Bin 
declarations that do not declare base bins. 

[0239] A bin Bbb has a set of bases which is the entire set of bins that Bbb is a 
refinement of. It is formally defined as follows: 

1 . If Aaa is the base bin of Bbb, then Aaa is in the set of bases of Bbb. 

2. Any base of Aaa is also in the set of bases of Bbb. 

[0240] BinGroup names are global in a TestPlan. 

[0241] Bin names are local to a BinGroup. 

[0242] A SetBin statement is only allowed for a leaf bin. 
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C++ for Bin Deflnitions 

[0243] With above rules, an object type BinGroup can be constructed for each of the 

BinGroup declarations in the BinDefs declaration. The class BinGroup will have a 

subclass LeafBinGroup. The operations of these two classes are the same, except that 
5 BinGroup::incrementBin is a C++ protected operation, whereas 

LeafBinGroup "increments in is a C++ public operation. 

[0244] The following is a default constructor which builds a BinGroup or a 

LeafBinGroup which is not a refinement of any other BinGroup. 

[0245] Constructors: 
1 0 BinGroup(BinGroup& baseBinGroup); 

LeafBinGroup(BinGroup& baseBinGroup); 

that builds a BinGroup that is a refinement of the given baseBinGroup. 

[0246] A method 

Status addBin(const String& binName, 
] 5 const String& description, 

const String& baseBinName); 

to define a bin and its description. If it is a most base bin, the baseBinName parameter 

must be the empty string. 

[0247] Methods to increment bin counters: 
20 Status incrementBin(const String& binName); 

This operation will increment the counter for this bin, and for all bins that are bases of this 

bin. The operation is protected in the class BinGroup, and is public in the class 

LeafBinGroup. 

[0248] Methods to reset bin counters 
25 Status resetBin(const String& binName); 

This operation will reset the counter for this bin, and for all bins that are the bases of this 
bin. 

[0249] Methods to get information about a bin: 

Status getBinDescription(c6nst String& binName, 
30 String& description); 

Status getBaseBin(const String& binName, 

BinGroup* pBaseBinGroup, 

String& baseBinName); 
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Status getBinValue(const String& binName, 

unsigned int& value); 

[0250] Iterators will be provided to get at all the currently defined bin names. 

[0251] TestPlan state will be include number of BinGroup members, one for each 

5 BinGroup declaration. The C++ for the above BinDefinitions would be as follows: 

// TestPlan constructor 
TestPlan: :TestPlan() 

: m_PassFailBinsO, // Default Constructor 

m_HardBins(&m_PassFailBins), 
10 m_SoftBins(&m_HardBins) 

{} 

// Bin initializations 

m_PassFailBins.addBin("Pass", "Count of passing DUTS.",""); 
1 5 m_PassFailBins.addBin("Fail", "Count of failing DUTS.",""); 

m_HardBins.addBin("3GHzPass", "Duts passing 3GHz", "Pass"); 

[0252] State for a TestPlan includes a m_pCurrentBinGroup which is initialized to the 
20 undefined BinGroup (NULL) and the m_currentBin undefined bin name (the empty string). 
Each time a SetBin statement is executed, the m_pCurrentBinGroup is changed to the 
indicated the named BinGroup and the m_currentBin to the named bin in the group by a 
call: 

// Translation of: SetBin SofitBins."3GHzAllPass"; 
25 pTestPlan->setBin("SoftBins", "SGHzAllPass"); 

[0253] When the test plan completes execution, it will call 

m_pCurrentBinGroup->incrementBin(m_currentBin); 

30 causing this bin and all its base bins to have their counters incremented. 

[0254] The BinGroup counters are reset when the test plan is elaborated, but are not 
reinitialized each time a test is run. The counters can be reset by an explicit call to- 
BinGroup:: resetBin. 

C. The Test Plan 

35 [0255] The test plan can be thought of as a main structure of the test program. The 

Test Plan can import files, as well as define similar constructs inline. Thus, it is possible to 
import a file given definitions of some globals, as well as declaring additional globals 
inline. 
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CI. Test Plan Flows and Flowltems 

[0256] One of the critical elements of the Test Plan is the Flow. A Flow encapsulates a 
finite state machine. It comprises several Flowltems which run an IFlowable object and 
then transition to another flow item. Running an IFlowable involves running an object that 
5 implements the IFlowable interface. Typical objects that implement the IFlowable 
interface are Tests and Flows themselves. 

[0257] Thus, a Flow has Flowltems which runs Tests and other Flows, and then 
transition to another Flowltem. It also provides for the opportunity to call user customized 
routines on various return results from ruiming an IFlowable. Typically, a Flow thus has 
10 the following form: 

# 

# FlowTestl implements a finite state machine for the 

# Min, Typ and Max flavors of MyFunctionalTestl . On 

# success it tests TestlMin, TestlTyp, TestlMax 

1 5 # and then returns to its caller with 0 as a successful 

# status. On failure, it returns 1 as a failing status. 
# 

# Assume that the tests MyFunctionalTestl Min, ... all 

# return a Result of 0 (Pass), 1 and 2 (for a couple 
20 # of levels of failure). 

# Result 0 Result 1 Result 2 

# TestlMin TestlTyp return 1 return 1 

# TestlTyp TestlMax return 1 return 1 

# TestlMax return 0 return 1 return 1 
25 # 

Flow FlowTestl 
{ 

Flowltem FlowTestl _Min MyFunctionalTestl Min 
{ 

30 Result 0 

{ 

Property PassFail = "Pass"; 
IncrementCounters PassCount; 
GoTo FlowTestl _Typ; 

35 } 

Result 1 

{ 

Property PassFail = "Fail"; 
40 IncrementCounters FailCount; 

Return 1; 

} 



# This result block will be executed if 



10 
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# MyFunctionalTestlMin returns any of 

# 2, 5, 6, 7, -6, -5 or -4 
Result 2, 5:7, -6:-4 

{ 

Property PassFail = "Fail"; 
IncrementCounters FailCount; 
Return 1; 

} 

} 



Flowltem FlowTestl_Typ { ... } 
Flowltem FlowTestl_Max { ... } 

} 

[0258] The operation of tlie Flow FlowTestl is as follows: 
15 1 . Starts up with executing Flowltem FlowTest l_Min. 

2. FlowTestl_Min runs a functional test, MyFunctionalTestlMin. Details of 
this test are provided when the complete test plan is presented below. 

3. Nine results are expected from running this test, 0, 1,2, 5, 6, 7, -6, -5 or -4. 
The first two Result clauses handle 0 and 1 respectively, and the third 

20 handles all the rest of the result values. 

4. If result "0" (pass) occurs, then FlowTest l_Min will increment the counter 
PassCounter. It will then transition to a new Flowltem FlowTest l_Typ. 

5. If result "1" or result "2" occurs, then FlowTestl_Min will increment the 
counter FailCounter, and return from the flow. 

25 6. FlowTest l_Typ will operate in the same way, and on success call 

FlowTest l_Max. 

7. FlowTestl_Max will operate in the same way, and on success return from 
FlowTestl with a successful result ("0"). 

[0259] Thus, FlowTestl will, on a successful run, run a device through the minimum, 
30 typical and maximum versions of Test!, and then return. FlowTest2 will operate in a like 
marmer. 

[0260] A Flow as described above basically describes a Finite State Machine with 
states and transitions. The Flowltems are basically states, which will do the following: 

1 . Execute an IFlowable (it could be a previously defined Flow, or a Test, or a 
35 user defined Flow that can be implemented in C++ with the above rules). 
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2. Execution of the IFlowable return a numeric result. Based on the result, 

certain actions occur (updating some counters), and then one of two things 
happen: 

a. The Flow returns to the caller with a numeric result. 

5 b. The Flow continues by transitioning to another state (Flowltem). 

[0261] Thus, a Flowltem has the following components: 

A Flowltem has a name. 

A Flowltem has an IFlowable to be executed. 

A Flowltem has a number or Result clauses. 

10 Each Result clause of a Flowltem provides actions and ends with a transition and is 

associated with one or more result values. 

[0262] These items are syntactically as follows in a Flowltem. 

Flowltem <name> <IFlowable to be executed> 
{ 

1 5 Result <one or more result values> 

{ 

<actions for these result values> 
<transition for these result values> 

} 

20 

Result <one or more other result values> 
{ 

} 

25 

} 

[0263] The IFlowable to be executed could be either a Test, qr a User-defined 
IFlowable, or a Flow. The actions for a result could be any of the following: 

A Property Action to set string valued entities that are used by GUI tools to. 
30 attribute results. This can be seen in the above FlowTestl example with: 

Property PassFail = "Pass"; 

[0264] Properties are basically named string or integer valued entities that are 
associated with a Result clause. There can be any number of them, and they are preferably 
used by tools such as GUIs which a user would use to display information associated with 
35 this result. They have no effect on the actual result of the test, or the flow of the test. 
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[0265] A Counters Action to increment some number of counters. This can be seen in 

the above example with: 

IncrementCounters PassCount; 
A Routine Call Action to call an arbitrary or user routine. This is discussed later. 
[0266] Finally, a Flowltem has a Transition which could either be a GoTo statement to 
transfer control to another Flowltem, or a Return statement to transfer control back to the 
caller (either a calling flow, or the system routine which initiated the test plan). 

Predefined Flows 

[0267] The typical use of Flow objects is to define a sequence of Tests. This sequence 
is then executed as a result of an event occurring in a Test Plan Server (TPS), i.e. the 
Execute Test Plan event. A test plan server on each site controller executes the user's test 
plan. However, Flow objects are also executed in response to other events. The name in 
parentheses is the name used in assigning Flows to these events. 

1 . System Load Flow (SysLoadFlow). This Flow is executed on the 
System Controller when a Test Plan is loaded onto one or more Site 
Controllers. ' It is executed prior to the actual loading of the Test 
Plan on any Site Controller. This flow allows the Test Plan 
developer to define actions that should originate from the System 
Controller. Such actions include broadcast load of Pattern files, 
Calibration actions, etc. 

2. Site Load Flow (SiteLoadFlow). This Flow is executed on the Site 
Controller after a Test Plan has been loaded onto the Site and 
initialized. This allows any Site-specific initialization to occur. 

3. Lot Start/End Flows (LotStartFlow/LotEndFlow). These Flows 
execute on the Site Controllers when the Test Plan Server is hotified 
of a start of a new lot. This is typically used in production 
environments to annotate datalog streams with lot-specific 
information. 

4. DUT Change Flow (DutChangeFlow). This Flow executes on the 
Site Controller when its DUT information changes. Again, this is 
typically used in production environments to update datalog streams. 
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5. TestPlan Start/End Flows (TestPlanStartFlow/TestPlanEndFlow). 

These Flows execute on the Site Controller when the Test Plan 
Server is instructed to start executing the current Test Flow and 
when that flow finishes its execution. 

6. Test Start/End Flows (TestStartFlow/TestEndFlow). These Flows 
execute on the Site Controller when the Test Flow is starting to run a 
new Test and when that Test finishes its execution. 

7. Test Flow (TestFIow). This Flow is the main Flow object executed 
when the Test Plan Server receives an ''Execute Test Plan" message. 

[0268] Note that if a user defines a Flow in the user's Test Plan that is not the 
TestFIow or one of the other pre-defined flows, the preferred way to have it executed is to 
include it in the transition states of one of these pre-defined flows. 

A Test Plan Example 

[0269] In the example below. Flows are given along with comments that describe the 

finite state machine implemented by the flow. The finite state machine is given as a 

transition matrix. Rows of the matrix correspond to Flowltems, and columns to the result. 

The entries of a row of the matrix indicate the Flowltem that is transitioned to from the 

Flowltem of the row when the returned Result is the value specified in the column. 

[0270] A Test Plan with three flows, FlowTestl , FlowTest2 and FlowMain, is shown 

below. FlowTestl will operate as described above. It will run a test named 

MyFunctionalTestl in each of the "min", "typ" and "max" configurations. Likewise, 

FlowTest2 will run MyFunctionalTest2 in each of these configurations. Finally, FlowMain 

will.run FlowTestl and FlowTest2. The finite state machine transition matrix is provided 

in comments at the start of each of these flows. 

# 

# File mySimpleTestPlan.tpl 

# . 

Version 0.1; 

Import xxx.pin; # Pins 

# Constants and variables giving limiting values. 
Import limits.usrv; 
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# Import test condition groups 
Import myTestConditionGroups.tcg; 

# Import some bin definitions. 
S Import bins.bdefs; 

# 

# Start of the test plan 

# 

10 TestPlan Sample; 

# This block defines Pattern Lists file-qualified names and 

# Pattern List variables that are used in Test declarations. 

# Pattern list variables are deferred till customization is 
1 5 # examined. 

PListDefs 
{ 

# File qualified pattern list names 
pi 1 A.plist:patl Alist, 
20 pl2A.plist:pat2AList 

} 

# The socket for the tests in this test plan (this is not imported, 

# but resolved at activation time): 
25 SocketDef = mytest.soc; 

# Declare some user variables inline 
UserVars 

{ 

30 # String name for current test 

String CurrentTest = "MyTest"; 

} 



35 TestCondition TC 1 Min 

{ 

TestConditionGroup = TCGl; 
Selector = min; 

} 

40 

TestCondition TClTyp 
{ 

TestConditionGroup = TCGl; 
Selector = typ; 

45 } 

TestCondition TCI Max 

{ 

TestConditionGroup = TCGl; 



wo 2005/114240 



PCT/JP2005/009815 



75 

Selector = max; 

} 

# Likewise for TC2Min, TC2Typ, TC2Max 



# 

# Declare a FunctionalTest. "FunctionalTest" refers to a C++ 

# test class that runs the test, and returns a 0, 1 or 2 as 

10 # a Result. The Test Condition Group TCGl is selected with 

# the "min" selector by referring to the TClMin TestCondition. 
# 

Test FunctionalTest MyFunctionalTestlMin 
{ 

1 5 PListParam = patl AList; 

TestConditionParam = TClMin; 

} 

# Another FunctionalTest selecting TCGl with "typ" 
20 Test FunctionalTest MyFunctionalTest 1 Typ 

{ 

PListParam = patlAList; 
TestConditionParam = TCI Typ; 

} 

25 

# Another FunctionalTest selecting TCGl with "max" 
Test FunctionalTest MyFimctionalTestlMax 

{ 

PListParam = patlAList; 
30 TestConditionParam = TCI Max; 

} 

# Now select TCG2 with "min" 

Test FunctionalTest MyFunctionalTest2Min 
35 { 

PListParam = pat2AList; 
TestConditionParam = TC2Min; 

} 

40 # Likewise for TCG2 with "typ" and TCG2 with "max" 

Test FunctionalTest MyFunctionalTest2Typ 
{ 

PListParam = patlAList; 
TestConditionParam = TC2Typ; 

45 } 

Test FunctionalTest MyFunctionalTest2Max 
{ 

PListParam = patlAList; 
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TestConditionParam = TC2Max; 



# 

5 # At this time the following Test objects have been defined 

# MyFunctionalTestlMin 

# MyFunctionalTestlTyp 

# MyFunctionalTestlMax 

# MyFunctionalTest2Min 
10 # MyFunctionalTest2Typ 

# MyFunctionalTest2Max 
# 

# 

# Counters are variables that are incremented during the 

1 5 # execution of a test. They are Unsignedlntegers that are 

# initialized to zero. 

# 

Counters {PassCount, FailCount} 

20 # 

# Flows can now be presented. A Flow is an object that 

# essentially represents a finite state machine which 

# can execute "Flowables", and transition to other flowables based 

# on the Result returned from executing a Flowable. A Flow can also 
25 # call another flow. 

# 

# A Flow consists of a number of Flowltems and transitions 

# between them. Flowltems have names which are unique in 

# the enclosing Flow, execute a "Flowable" object, and then 
30 # transition to another Flowltem in the same enclosing Flow. 

# 

# Flowable objects include Tests and other Flows. When 

# a Flowable object executes, it returns a numeric Result 

# which is used by the Flowltem to transition to another 
35 # Flowltem. As a result of this, both Tests and Flows 

# terminate by returning a numeric Result value. 

# 

# FlowTestl implements a finite state machine for the 

# Min, Typ and Max flavors of MyFunctionalTestl . On 
40 # success it tests Test 1 Min, Test 1 Typ, Test 1 Max 

# and then returns to its caller with 0 as a successful 

# Result. On failure, it returns 1 as a failing Result. 
# 

# Assume that the tests MyFunctionalTestlMin, ... all 
45 # return a Result of 0 (Pass), 1 and 2 (for a couple 

# of levels of failure). The Transition Matrix of the 

# finite state machine implemented by FlowTestl is: 

# 

# Result 0 Result 1 Result 2 
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10 



15 



20 



25 



FlowTestlTyp 
FlowTestlMax 
return 0 



# 

# 

# 

# where the IFlowables run by each Flowltem are: 
# 

# 



FlowTestl_Min 
FlowTestlTyp 
FlowTestl Max 



Flowltem 
FlowTestlMin 
FlowTestl_Typ 
FlowTestl Max 



return 1 return 1 

return 1 return 1 

return 1 return 1 



IFlowable that is run 

MyFunctionalTest 1 Min 
MyFunctionalTest 1 Typ 
MyFunctionalTest 1 Max 



Flow FlowTestl 
{ 

Flowltem FlowTestl _Min MyFunctionalTest 1 Min 
{ 

Result 0 

{ 

Property PassFail = "Pass"; 
IncrementCounters PassCount; 
GoTo FlowTestl _Typ; 

} 

Result 1,2 

{ 

Property PassFail = "Fail"; 
IncrementCounters FailCount; 
Return 1; 

} 



30 Flowltem FlowTestl Typ MyFunctional Test 1 Typ 

{ 

Result 0 

{ 

Property PassFail = "Pass"; 
35 IncrementCounters PassCount; 

GoTo FlowTestl_Max; 

} 

Result 1,2 

40 { 

Property PassFail = "Fail"; 
IncrementCounters FailCount; 
Return 1; 

} 



45 } 



# Likewise for FlowTestl _Max 

Flowltem FlowTestl Max MyFunctionalTest 1 Max 

{ 
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Result 0 

, { 

Property PassFail = "Pass"; 
IncrementCounters PassCount; 
5 Return 0; 

} 

Result 1,2 

{ 

1 0 Property PassFail = "Fail"; 

IncrementCounters FailCount; 
Return 1; 

} 

} 

15 } 



20 



25 



30 



35 



40 



45 



# 

# FlowTest2 is similar to FlowTestl . It implements a 

# finite state machine for the Min, Typ and Max flavors 

# of MyFunctionalTest2. On success it tests Test2Min, 

# Test2Typ, Test2Max and then returns to its caller with 

# 0 as a successful Result. On failure, it returns 1 as 

# a failing Result. 
# 

# Assume that the tests MyFunctionalTest2Min, ... all 

# return a Result of 0 (Pass), 1 and 2 (for a couple 

# of levels of failure). The Transition Matrix of the 

# finite state machine implemented by FlowTest2 is: 
# 

Result 0 Result 1 



FlowTest2_Typ 
FlowTest2_Max 
return 0 



# 
# 
# 
# 
# 
# 

# Where the IFlowables run by each Flowltem are: 
# 
# 
# 
# 
# 

Flow FlowTest2 
{ 

#... 

} 



Result 2 



FlowTest2_Min 

FlowTest2_Typ 
FlowTest2 Max 



Flowltem 
FlowTest2_Min 
FlowTest2_Typ 
FlowTest2 Max 



return 1 return 1 

return 1 return 1 

return 1 return 1 



IFlowable that is run 

MyFunctionalTest2Min 
MyFunctionalTest2Typ 
MyFunctionalTest2Max 



# 
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# Now the FlowMain, the main test flow, can be presented. It 

# implements a finite state machine that calls FlowTestl 

# and FlowTest2 as below: 

# 

5 # Result 0 Result 1 

# - 

# FlowMain_l FlowMain_2 return 1 

# FlowMain_2 return 0 return 1 

# 

10 # Where the IFlowables run by each Flowltem are: 

# Flowltem IFlowable that is run 

# FlowMain_l FlowTestl 
U FlowMain_2 FlowTest2 
Flow FlowMain 

15 { 

# The first declared flow is the initial flow to be 

# executed. It goes to FlowMain_2 on success, and 

# returns 1 on failure. 
Flowltem FlowMain_l FlowTestl 

20 { 

Result 0 

{ 

Property PassFail = "Pass"; 
IncrementCounters PassCount; 
25 GoTo FlowMain_2; 

} 

Result 1 

{ 

30 # Sorry ... FlowTestl failed 

Property PassFail = "Fail"; 
IncrementCounters FailCount; 

# Add to the right soft bin 

35 SetBin SoftBins."3GHzSBFTFair'; 

Return 1; 

} 

} 

40 Flowltem FlowMain_2 FlowTest2 

{ 

Result 0 

{ 

# All passed! 

45 Property PassFail = "Pass"; 

IncrementCounters PassCount; 



# Add to the right soft bin 
SetBin SoftBins."3GHzAllPass"; 
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15 



Return 0; 

} 

Result 1 

{ 

# FlowTestl passed, but FlowTest2 failed 
Property PassFail = "Fail"; 
IncrementCounters FailCount; 

# Add to the right soft bin 
SetBin SoftBins."3GHzCacheFail"; 

Return 1: 



} 



TestFlow = FlowMain; 
20 [0271] The above test plan is structured as follows in a preferred order: 

1 . First, a version number is provided. This number is used to ensure 
compatibility with the compiler version. 

2. Then, a number of imports are declared. These are various files with 
declarations needed in order to resolve names used in the test plan. 

25 3. Next, the Test Plan name is declared, after which come the inline 

declarations of the test plan. 

4. Next a set of PListDefs are declared. These include file-qualified names 
naming GlobalPLists from the named files. They also include Pattern 
List variables. Pattern List variables are variables that can be initialized 

30 in custom flowables at execution time. They provide a means of 

delaying binding tests to actual pattern lists until runtime. 

5. Next, a set of C/jerKflr« is declared. These include a string. 

6. Some Counters are then declared, to determine the number of tests 
passed and failed. Counters are simply variables that are initialized to 

35 zero, and incremented at IncrementCounter statements. They are 

different from Bins described eariier which have the semantics that only 
the currently set bin is incremented at the end of the test of a DUT. 
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7. Next, a series of Test Conditions is declared. Each of these specifies a 
Test Condition Group and a selector. In this example, the Test 
Condition Groups come from mytestconditionsgroups.tcg. However, 
they could have been inline in the test plan. 

5 8. Next, a series of Flowables or Tests is declared. Each of this is known 

Test FunctionalTest which selects a Pattern List and a test condition. 
Thus for instance, MyFunctionalTestlMax selects the test condition 
TCI Max and a pattern list. 

9. Following this, three flows are declared, FlowTestl, FlowTest2 and 
10 FlowMain. Flows run i^/owoi/e^. Flowables include Tests (such as 

MyFunctionalTestlMax) and other flows (such as FlowTestl and 
FlowTest2). Each of FlowTestl and FlowTest2 run through the 
minimum, typical and maximum versions of Test 1 and Test2 
respectively. The flow FlowMain calls the earlier declared flows, 
1 5 FlowTestl and then FlowTest2. 

10. Finally, the TestFlow event is assigned to the FlowMain Flow. Thus the 
flow FlowMain is the one that will be executed by this test plan when a 
user chooses to Execute this plan. 



C++ for Flows 

20 [0272] With the above rules, a C++ implementation can be done for most of the 
elements, with the exception of the Flows themselves. 

C++ for Flowltems 

[0273] The C++ class to represent a Flowltem may have the following interface: 
An operation 

25 Status setFlowable(IFlowable* pIFlowable); 

which will set the IFlowable that will be executed for this Flowltem. 
[0274] Once the Flowltem returns from the set of calls needed to execute this 
IFlowable, it will need to increment a list of counters depending on the Result value. To 
this end, the Flowltem needs to have a vector of counters that is to be incremented. This is 

30 initialized by a call: 

Status setCounterRefs(unsigned int result. 
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CounterRefList counterRefs); 

Calling this sets up a vector of references to counters into the Flowltem, so that it can 
increment them once the IFlowable completes execution. For example, the statement 
IncrementCounters A, B, C; 

5 would preferably use the above call as follows: 

// Somewhere earlier 
CounterRefList counters; 

// Code for Result clause 
10 // Result2,3 {...} 

//offlowObject. 

counters.resetQ; 

counters.add(&A); 

counters. add(&B) ; 
1 5 counters . add(&C) ; 

flowObject.setCounterRefs(2, counters); 

flowObject.setCounterRefs(3, coxmters); 
[0275] A temporary CounterRefList object named counters is used. Initially 

counters.resetQ is called, followed' by a number of counters.addQ calls to set up the 

20 counters list. This is then used to setup the vector of counter addresses to be updated for 

result values 2 and 3. 

[0276] The Flowltem may then need to transition to another Flowltem on a particular 
result: 

Status setTransition(unsigned int result, Flowltem* pFlowItem); 
25 Several such calls will naturally need to be made in the case that a certain Result clause 
deals with many result values. 

[0277] The Flowltem may need to return a result. This is done by: 

Status setRetumResult(unsigned int result, 
unsigned int returnResult); 
30 [0278] For example, for the Flowltem FirstFlowItem in the previous example, the 
above would be called with the value "2" for "result" and "1" for "returnResult". 

Finally, the Flowltem needs an operation to execute: 

Status execute(unsigned int& result, Flowltem* pNextFlowItem); 
[0279] This operation will execute the IFlowable, then update the indicated counters, 
35 and then either return a Result, or a pointer to the next Flowltem. If this pointer is NULL, 
then the result is the returned value. 
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[0280] The code that would be generated for Flowltem FiowMain_l is as follows: 



Flowltem FIowMain_l ; 
Flowltem FlowMain_2; 

5 CounterRefList, counters; 

FlowMainl .setFlowable(FlowTest 1 ); 

// Result 0 
10 counters. resetQ; 

counters.add(&PassCount); 
FlowMain_l .setCounterRefs(0, counters); 
FlowMain_l .setTransition(0, &FlowMain_2); 

15 // Result 1 

counters. resetQ; 

counters . add(&Fai ICount) ; 

FlowMain_l .setCounterRefs(l, counters); 

20 // The following call from ITestPlan will set the 

// current bin group and bin name. 
pTestPlan->setBin("SoftBins", "BGHzSBFTFail"); 
FlowMain_l.setRetumResult(l, 1); 

25 [0281] The code generated above sets up FlowMain_l to run the IFlowable 

"FlowTestl", and then sets it up to increment the appropriate list of counters for each result, 
and finally to take the necessary actions. The necessary action in the case of result "0" is a 
transition to FlowMain_l, and in the case of result "1" is a return. 

C2. Counter Support in a TestPian 
30 [0282] Counters are variables that are initialized to zero, and can be incremented by an 
IncrementCounter statement at various points during a test run. They are different from 
Bins, which are incremented only at the end of the test. Furthermore, bins are hierarchical 
while counters are simple variables. Thus, counters are a much simpler and more limited 
facility than bins. 

35 [0283] Counters can be supported in a TestPian via a member of a Counters class that 
maintains a set of named counters which are unsigned integers. Objects will be defined in 
this class via a Counters declaratiori. Coimters will not be automatically reset when a test 
starts, thus allowing a TestPian to gather counts over testing many DUTs. Methods will be 
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provided to reset, increment and query the value of a counter. This enables an alternative 

to binning in order to determine counts as a resuh of running a test. 
[0284] The TestPlan preferably contains a member variable, m_modifiedCounters, 
which is the set of counters modified by running the test on a DUT. This set is initialized 
5 to the empty set at the start of the test. At each place an IncreraentCounters call is made, 
code will be generated to add the named counters to the m_modifiedCounters member. 
Thus, this member gathers together all the counters that were modified during the 
execution of a test on a DUT. 

C++ for the Flow Object 
10 [0285] Once all the Flowltems have been created, the Flow object can be created as a 
C++ object as shown below: 

An operation to add a Flowltem 

Status addFlowItem(FlowItem* pFlowItem, bool isInitalFlowltem); 

which will add the indicated Flowltem to the Flow. The boolean is set to 
1 5 True if this is the initial Flowltem of the Flow. 

An operation to execute the Flow 

Status executeFlow(imsigned int& result); 

[0286] This will preferably rettim when the Flow returns, with the result of executing 
the flow. The action of this is to start executing the flow with the initial Flowltem. It will 
20 keep executing Flowltems as long as the current Flowltem returns a next Flowltem to 

execute. When the current Flowltem returns a Result, then this operation completes with 
that Result. 

[0287] Hence, the C++ code generated for a Flow has several repeated calls to 
addPlowltemO in order to add Flowltems to the Flow. The executeFlowQ operation will 
25 occur when this Flow in the Test Plan is selected for execution. 

C3. Test Classes 

[0288] In general majority of the program code is data for device test, and the rest is 
the code of test program, which realizes the test methodology. This data is DUT- 
dependent (e.g., power supply conditions, signal voltage conditions, timing conditions, 
30 etc.). The test code consists of methods to load the specified device conditions on to ATE 
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hardware, and also those needed to realize the user specified objectives (such datalogging, 
etc). 

[0289] As explained above, to increase the reusability of test code, such code should be 
independent of any device-specific data (e.g., pin name, stimulus data, etc.), or device-test- 
5 specific data (e.g., conditions for DC units, measurement pins, number of target pins, name 
of pattern file, addresses of pattern programs, etc.). If code for a test is compiled with data 
of these types, the reusability of the test code would decrease. Therefore, any device- 
specific data or device-test-specific data should be made available to the test code 
externally, as inputs during code execution time. 

10 [0290] In the open architecture test system, a Test Class, which is an implementation 
of the ITest interface, realizes the separation of test data and code (and hence, the 
reusability of code) for a particular type of test. Such a test class could be regarded as a 
"template" for separate instances of it, which differ from each other only on the basis of 
device-specific and/or device-test-specific data. Test classes are specified in the test plan 

15 file. Each Test class typically implements a specific type of device test or setup for device 
test. For example. Functional, AC and DC Parametric tests are preferably implemented by 
separate Test classes. However, custom test classes can also be used in test plans. 
[0291] Test classes allow the user to configure class behavior by providing parameters 
that are used to specify the options for a particular instance of that test. For example, a 

20 Functional Test will take parameters PList and TestConditions, to specify the Pattern List 
to execute, and the Level and Timing conditions for the test, respectively. Specifying 
different values for these parameters (through the use of different "Test" blocks in the test 
plan description file) allows the user to create different instances of a Functional Test. 
Figure 5 shows how different test instances 502 would be derived from a single test class 

25 504. 

[0292] These classes should be designed to allow the compiler 400 to take the ■ 
description of the tests and their parameters from the test plan file and generate correct 
C++ code, which can be compiled and linked to generate the test program. Test class 
instances may be added to objects describing test flow to create a complex execution 
30 sequence of device tests. 

C4. Derivation from ITest and IFIowable 
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[0293] As mentioned above, Test classes derive from ITest. With the above rules, 
these can be implemented in C++ classes that implement the ITest interface. In addition to 
the methods specified for the ITest interface, these classes provide the Test-specific 
intelligence and logic required to perform specific classes of device test. Test classes also 
5 implement the IFlowable interface. As a consequence of this, instances of Test classes can 
be used in Flowltems to run tests. 

Customization 

[0294] Customization mechanisms are provided to allow users to call C functions, and 
develop their own classes implementing the ITest and IFlowable interfaces. 

10 Introspection Capability 

[0295] If an object of a Test class could be interrogated regarding its methods and 
signatures, then it could be verified that the appropriate parameters are available for 
inclusion in the generated source code. Such a feature would be very useful for error 
checking and validation during the translation phase. If the test engineer made a mistake in 
1 5 the names of parameters, or the number (or possibly the types) of arguments to these 

parameters, the translation phase could catch it and provide a meaningful error message at 
translation time instead of waiting for a compile-time error message from the C++ 
compiler. This would be more useful to the test engineer. 

[0296] Introspection refers to the ability to ask an object to look within itself and return 
20 information regarding its attributes and methods. Some languages, such as Java, provide 
this ability as a part of the language. Other languages, such as Visual Basic, impose such a 
requirement on objects intended to be used with it. C++ makes np provisions for this 
feature. 

[0297] This method also lends well to providing for default parameter values, as well 
25 as indications of optional parameters. In addition, if this capability is provided as a' part of 
the implementation of all Test classes, then GUI applications could also use this 
information to dynamically build up dialogs and other user interface elements to help 
engineers make effective use of these classes. 

[0298] These complexities are offset in an embodiment of the invention through a 
30 mechanism that provides, in lieu of full introspection, a method that allows the Test class 
developer to fully specify, in a single text-based source file (per Test class), the public 
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methods/attributes of the Test class that the developer has designated as the ones required 
to parameterize the class. 

[02991 A single source is preferred: one would not want to have the description of the 
parameterization interface of a Test class in one file, and the C++ interface description in 
5 another independent (header) file, and then be burdened with the need to keep both sources 
synchronized. Towards this end, the "text-based" description is embedded in a pre-header 
file for the Test class, which is used by the compiler for limited introspection, as well for 
generating the C++ header for the Test class. The generated C++ header file is the one 
used to finally compile the Test class C++ code. 

10 The Pre-Headers 

[0300] The use of headers in C++ is well known. Because C++ is difficult to parse and 
read, however, an embodiment of the invention defines a syntax allowing the compiler to 
create a C++ output which can be used as a header by a test class developer. According to 
this embodiment, the test class developer writes a pre-header, which is output by the 

1 5 compiler 400 as a header file, allowing visibility into the corresponding test classes or 
other test entities. 

[0301] The following example illustrates the concept of the pre-header file for a Test 
class in accordance with the preferred embodiment of the present invention. Consider the 
following excerpt fi-om a source file, v/ith a test FxmcTestl : 

20 

TestCondition TCI 

{ 

TestConditionGroup = TCGl; # Previously defined TCG for 
Levels 

25 Selector = min; 

} 

TestCondition TC2 

{ 

30 TestConditionGroup = TCG2; # Previously defined TCG for 

Timing 

Selector = min; 

} 

3 5 Test FimctionalTest FuncTest 1 

{ 

PListParam = patListl ; # Previously defined pattern list 

TestConditionParam = TCI; 
TestConditionParam = TC2; 
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} 

[0302] The compiler needs to know what a FunctionalTest entails in order to determine 
whether the declaration of FuncTestl above is legal. Rather than building in the 
knowledge of a FunctionalTest into the compiler, the definition of what a FunctionalTest 
5 entails can be specified in the Pre-Header. 

[0303] Assume that FunctionalTest is a C++ class having base classes Test! and Test2, 
and having members which are a PList, and an array of TestConditions, The compiler 
needs to know about the types of the members of FunctionalTest in order to recognize that 
the above declaration of FuncTestl is legal. 
1 0 [0304] Furthermore, in order to generate a C++ object declaration for FuncTest 1 , a 

C++ header for the class FunctionalTest needs to be constructed. This requires compiler to 
also know about the base classes of the FunctionalTest class, the names of its members and 
other such information. 

[0305] The pre-header sub-language of an embodiment of the invention provides the 

1 5 compiler with the information it needs to both recognize the legality of declarations, and to 

generate C++ headers and object declarations that correspond to declaration. 

[0306] Note that a FunctionalTest is a simple type (as far as parameterization is 

concerned), and thus, would use quite a simple description for parameterization. One 

could thus write a pre-header, FunctionalTest.ph, that supports the above parameterization 

20 as follows (assume that pre-headers are available for the base test classes Testl and Test2): 

Version 1.0; 
# 

# Parameterization specification pre-header for FunctionalTest 

# 

25 Import Testl .ph; # For base class Testl 

Import Test2.ph; # For base class Test2 

TestClass = FunctionalTest; # The name of this test class 
PublicBases = Testl, Test2; # List of public base classes 

# The parameters list or "parameter block": 
30 Parameters 

{ 

# The following declaration specifies that a FunctionalTest has 

# - a parameter of type PList 

# - [represented by C++ type Tester: :PattemTree] 
35 # - stored in a member named m_pPatList 

# - a function to set it named setPatternTree. 

# - a parameter description for the GUI to use as a tool tip 
PList PListParam 

{ 
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Cardinality = 1; 
Attribute = in_pPatList; 
SetFunction = setPattemTree; 

Description = "The PList parameter for a FunctionalTest"; 

5 } 

# 

# The following declaration specifies that a FunctionalTest has 

# - 1 or more parameters of type TestCondition 

# - [represented by C++ type Tester: :TestCondition] 
10 # - stored in a member named m testCondnsArray 

# - a function to set it named addTestCondition. 

# - a parameter description for the GUI to use as a tool tip 

# The [implement] clause causes the translation phase of to 

# generate a default implementation of this function. 
15 # 

TestCondition TestConditionParam 

{ 

Cardinality = 1-n; 
Attribute = m_testCondnsArray; 
20 SetFunction = addTestCondition [Implement]; 

Description = "The TestCondition parameter for a 
FimctionalTest"; 
} 

} 

25 # 

# The section belo\y is part of the Pre-Header which is an escape 

# into C++ code. This will be referred to as a "template block." 
# 

# Everj^ing in this section will be reproduced verbatim in the 
30 # generated header file, except for "$Class", "$Inc", 

# "SParamAryTypes", "$ParamAttrs", "$ParamFns" and "SParamlmpls" 

# 

# Note that no comments begirming with the '#' character are supported 

# within the following section. 
35 # 

CPlusPlusBegin 

$Inc 

namespace 

{ 

40 class SClass 

{ 

// Array types for parameters storage: 
SParamAry Types 

public: 

45 virtual void preExec(); 

virtual void exec(); 
virtual void postExecQ; 
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SParamFns 

private: 

double m_someVar; 
5 SParamAttrs 

}; 

SParamlmpls 
10 } // End namespace 

CPlusPlusEnd 
C++ For Parameterized Test Classes 

[0307] As the compiler processes a pre-header file, it builds up the values of the 
compiler variables such as Sine, SClass, SParamAry Types and others. This enables it to 
1 5 then create the following C++ header by generating the C++ code above verbatim, and 

expanding in the values of the compiler variables Sine, SClass, etc. at the indicated places. 
For FunctionalTest.ph, it creates the following C++ header file FunctionalTest.h for the 
FunctionalTest class. 

#line 7 "./FunctionalTest.ph" 
20 #include <ITest.h> 

#line 5 "./FunctionalTest.ph" 

#include <Testl.h> 

#line 6 "./FunctionalTest.ph" 

#include <Test2.h> 
25 #line 55 "./FunctionalTest.ph" 

#include <vector> 

#line 55 "./FunctionalTest.ph" 

#include <Levels.h> 

#line 55 "./FunctionalTest.ph" 
30 #include <TestCondnGrp.h> 

#line 56 "./FunctionalTest.ph" 

namespace 

{ 

35 #line 7 "./FunctionalTest.ph" 

class FunctionalTest : public ITest, 
#line 8 "./FunctionalTest.ph" 

public Testl, 

#line 8 "./FunctionalTest.ph" 
40 public Test2 

#line 59 "./FunctionalTest.ph" 
{ 



wo 2005/114240 



PCT/JP2005/009815 



91 

// Array types for parameters storage: 
#line 61 "./FunctionalTest.ph" 
public: 

#line 37 "./FunctionalTest.ph" 

typedef std::vector<Tester: :TestCondition *> 
TestConditionPtrsAry_t; 

#line 62 "./FunctionalTest.ph" 
public: 

virtual void preExecQ; 
virtual void execQ; 
virtual void postExecQ; 

public: 

#line 7 "./FunctionalTest.ph" 

void setName(OFCString &name); # Automatic for all tests 
#line 22 "./FunctionalTest.ph" 

void setPatternTree(PatternTree *); 
#line 23 "./FunctionalTest.ph" 

String getPListParamDescriptionO const; 
#line 39 "./FunctionalTest.ph" 

void addTestCondition(TestCondition *); 
#line 40 "./FunctionalTest.ph" 

void getTestConditionParamDescriptionO const; 

#line 67 "./FunctionalTest.ph" 

private: 

double m_someVar; 

#line 70 "./FunctionalTest.ph" 

private: 

#line 7 "./FunctionalTest.ph" 

OFCString in_name; # Automatic for all tests 
#line 21 "./FunctionalTest.ph" 

Tester: :PatternTree *m_pPatList; 
#line 38 "./FunctionalTest.ph" 

TestConditionPtrsAryt m_testCondnsArray; 
#line 71 "./FunctionalTest.ph" 

}; 

#line 7 "./FunctionalTest.ph" 
inline void 

#line 7 "./FunctionalTest.ph" 
FunctionalTest::setNaine(OFCString &nanie) 
#line 74 "./FunctionalTest.h" 
{ 

m_name = name; 
return; 

} 
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#line 39 "./FunctionalTest.ph" 
inline void 

#line 39 "./FunctionalTest.ph" 

FunctionalTest::addTestCondition(TestCondition *arg) 
5 #line 74 "./FunctionalTest-ph" 

{ 

in_testCondnsArray.push_back(arg); 
return; 

} 

10 #line 23 "./FunctionalTest.ph" 

inline void 

Tester: :String FunctionalTest: :getPListParaniDe$criptionQ 
{ 

return "The PList parameter for a FunctionalTest"; 

15 } 

#line 40 "./FunctionalTest.ph" 
inline void 

Tester:: String FunctionalTest::getTestConditionParamDescriptionO 

{ 

20 return "The TestCondition parameter for a FunctionalTest"; 

} 

#line 75 "./FunctionalTest.ph" 
} // End namespace 

25 [0308] As described earlier, this pre-header enables the compiler to check the validity 
of a FunctionalTest declaration, to generate code for it, and to generate a C++ header that 
would be needed by it. 

[0309] As an example, consider the FunctionalTest declaration given earlier, 

reproduced below for convenience: 

30 Test FunctionalTest FuncTestl 

{ 

PListParam = patListl ; # Previously defined pattern list 

TestConditibnParam = TCI; 
TestConditionParam = TC2; 

35 } 

[0310] The C++ header that would be generated for this by the compiler is given above. 

The compiler would generate the following code for the above FunctionalTest construct: 

FunctionalTest FuncTestl; 
FuncTestl .setName("FuncTestl "); 
40 FuncTest 1 . setPattemTree(&patList 1 ); 

FuncTest 1 . addTestCondition(&TC 1 ); 
FuncTest l.addTestCondition(&TC2); 
[0311] Notice also the name that is generated for the Description function. Each 

parameter named Xxx is associated with a member fiinction: 
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Status getXxxDescriptionO const; 
that returns the string with a description for the tool tip that the GUI can use. 

Other Pre-Header Features 

[0312] The pre-header supports some other user defined enumerations as an additional 
type. This allows the GUI to provide a drop down list of possible choices that could be 
used for setting the value of a particular parameter. Furthermore, the pre-header provides a 
feature to associate a number of parameters that can be thought of as a table. For example, 
it may be convenient to implement an array of "properties" as an associated set of an array 
of strings for the names, and an array of integers for the values. One easy way of 
implementing this feature is to use an array of custom types (discussed later). However, 
that requires the user to write a custom type pre-header to use. Both of these features are 

illustrated in the following example: 

# — . . — . 

# File FooBarTest.ph 
# 

# Parameterization specification pre-header for 

# custom test class FoobarTest 

# 



Version 1.0; 

Import Testl .ph; # For base class Testl 

TestClass = FoobarTest; U The name of this test class 
PublicBases = Testl ; # List of public base classes 

# The parameters list: 
Parameters 

{ 

# An enumerated type 

Enum WishyWashy = Yes, Perhaps, Possibly, Maybe, MaybeNot, 

No; 

# Define a WishyWashy parameter. 
WishyWashy WW 

{ 

Cardinality = 1 ; 
Attribute = mww; 
SetFunction = setWw; 

Description = "The WW parameter for a Foobar Test"; 

} 
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# This class has an array of name-number pairs that is 

# interpreted in the class. 
ParamGroup 

{ 

5 Cardinality = 0-n; 

# The Name field in this array is: 

# - of type String 

# - [represented by C++ type Tester: :String] 
10- # - stored in a member named m_NameArray 

# - a function to set it named addName. 

# - a parameter description for the GUI to use as a tool tip 
String Name 

{ 

1 5 Attribute = m_NameArray; 

SetFunction = addName; 
Description = "A Name with a Value"; 

} 

20 # The Number field in this array is: 

# - of type Integer 

# - [represented by C++ type int] 

# - stored in a member named m_NumberArray 

# - a function to set it named addNumber. 

25 # - a parameter description for the GUI to use as a tool tip 

Integer Number 

{ 

Attribute = m_NumberArray; 
SetFunction = addNumber; 
30 Description = "The value of the Name"; 

} 

} 

# The following declaration specifies that a FunctionalTest has 
35 # - a parameter of type PList 

# - [represented by C++ type Tester; :PatternTree] 

# - stored in a member named m_pPatList 

# - a function to set it named setPatternTree. 

# - a parameter description for the GUI to use as a tool tip 
40 PList PListParam 

{ 

Cardinality = 1; 
Attribute = m_pPatList; 
SetFunction = setPatternTree; 
45 Description = "The PList parameter for a FunctionalTest"; 

} 



# The following declaration specifies that a FunctionalTest has 
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# - 1 or more parameters of type TestCondition 

# - [represented by C++ type Tester: :TestCondition] 

# - stored in a member named m testCondnsArray 

# - a function to set it named addTestCondition. 

5 # The [implement] clause causes the translation phase of to 

# generate a default implementation of this function. 
# 

TestCondition TestConditionParam 
{ 

10 Cardinality = 1-n; 

Attribute = m_testCondnsArray; 
SetFunction = addTestCondition [Implement]; 
Description = "The TestCondition parameter for a 
FunctionalTest"; 
15 } 

} 

CPlusPlusBegin 
Sine 

20 namespace 
{ 

class SClass 

{ 

// Array types for parameters storage: 
25 SParamAryTypes 

public: 

virtual void preExecQ; 
virtual void execQ; 
virtual void postExecQ; • 
30 SParamFns 

//... 

private; 

double m_someVar; 
SParamAttrs 

35 // ... 

}; 

//... 

SParamlmpIs 

} // End namespace 

40 CPlusPlusEnd 

[0313] It must be noted that a custom type name-number pairs could have been 

declared, and a single array parameter of that custom type could have been used to have 

the same effect as the above ParamGroup of parameters. The technique presented above 

is a convenience that avoids the necessity of declaring a custom type. 
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C5. Custom Function Declarations 

[0314] This allows the user to call custom functions when a flow transition takes place. 
Custom functions are declared through pre-header as follows: 

# 

5 # File MyFunctions.ph 

# 

# Parameterization specification pre-header for MyF unctions 
# . 

10 Version 1.0; 

Functions = MyFunctions; # The name of this group of functions 

# Declare the following C++ function in the 

15 # MyFunctions namespace to determine the minimum 

# of two values. 

# // Return the minimum of x, y 

# double MyRoutines::Min 

# (ITestPlan* pITestPlan,int& x, int& y); 
20 Integer Min(Integer x. Integer y); 

# Declare the following C++ function in the 

# UserRoutines namespace to return the average of 

# an array. 

25 # // Return the average of the array 

# double MyRoutines : : Avg 

# (ITestPlan* pITestPlan, double* a, const int a_size); 

# The C++ function will be called with a and a'Length 
Double Avg(Double a[]); 

30 

# Declare the following C++ function in the 

# UserRoutines namespace to print the dut id 

# and a message 

# // Return the average of the array 
35 # double MyRoutines: :Print 

# (ITestPlan* pITestPlan, String* msg, unsigned int& 
dutid); 

# The C++ function will be called with a and a'Length 
Void Print(String msg, Unsignedlnteger dutId); 

40 

[0315] Typically a C++ section needs to be provided for the above declarations, as the 
compiler will expand these declarations in a standard way. The user is of course 
responsible for the C++ implementation of these functions. Note that all of the above 
functions will presumably take an ITestPlan pointer as an implicit first parameter. This 
45 pointer provides the function writer access to stateS in the TestPlan. For instance, the 
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function writer could use the ITestPlan interface to access the current Flow, the current 
Flowltem in the flow, the current Result clause, values of UserVars, and other such 
information. Certain tester defined functions are available for use in the file Functions.ph: 

Version 1.2.3; 

5 

# 

# File Functions.ph 

# 

Functions = Functions; # The name of this group of functions 

10 

# Declare the following C++ function in the 

# Functions namespace 

# Returns the ID of the current DUT being tested by the 
15 # caller. 

Unsignedlnteger GetDUTIDQ; 



C++ for Custom Function Declarations 

[0316] The C++ code that would be generated by compiler for MyFunctions above is 

20 to simply declare some functions in the MyFunctions namespace: 

namespace MyFunctions 
{ 

double Min(ITestPlan* pITestPlan, int& x, int& y); 
double Avg(ITestPlan* pITestPlan, double* a, const int a_size); 
25 void Print(ITestPlan* pITestPlan, char* Msg, unsigned int dutID); 

} 

[0317] These fimctions will be callable from a flow. 
C6. Custom Flowables 

[0318] It is also possible to create a pre-header implementing the C++ IFlowable 
30 interface using the pre-header. This enables a user to define custom flowables that can be 
run in a Flowltem. Shown below is a pre-header for the user-defined Flowable 
MyFlowable: 

# 

# File MyFIowable.ph 

35 # 

# Parameterization specification pre-header for MyFlowable 

# : 

Version 1.2.4; 

40 

FlowableClass = MyFlowable; # The name of this custom class 
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# The parameters list: 
Parameters 

{ 

5 # The following declaration specifies that a MyFlowable has 

# - 1 optional parameter Intl of type Integer 

# - [represented by C++ type int] 

# - stored in a member named mjntl Val 

# -a function to set it named setlntl Val. 
10 Integer Intl 

{ 

Cardinality = 0-1; 
Attribute = mintlVal; 
SetFunction = setlntl Val; 

15 } 

# The following declaration specifies that a MyFlowable has 

# - 1 mandatory parameter Int2 of type Integer 

# - [represented by C++ type int] 

20 # - stored in a member named m_int2Val 

# - a function to set it named setInt2Val. 
Integer Int2 

{ 

Cardinality = 1 ; 
25 Attribute = m_int2Val; 

SetFunction = setInt2Val; 

} 

# The following declaration specifies that a MyFlowable has 

# - one or more parameters of type String 
30 # - [represented by C++ type Tester:: String] 

# - stored in a member named m_stringArrVal 

# - a function to set it named addStringVal. 
String Stringltem 

{ 

35 Cardinality = 1-n; 

Attribute = m_stringArrVal; 
SetFunction = addStringVal; 

} 

40 # The following declaration specifies that a MyFlowable has 

# - A single PList parameter 

# - [represented by the C++ type Tester: :PList] 

# - stored in a member named m_plist 

# - a function to set it named setPListParam 
45 PList PListParam 

{ 

Cardinality = 1 ; 
Attribute = m_plist; 
SetFunction = setPListParam; 
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} 

} 

# 

5 # The section below is part of the Pre-Header which is an escape 

# into C++ code. 
# 

# Everything in this section will be reproduced verbatim in the 

# generated header file, except for "$Class", "Sine", 

1 0 # "SParamAryTypes", "SParamAttrs", "SParamFns" and 

"SParamlmpls". 
# 

# Note that no comments beginning with the '#' character are supported 

# within the following section. 
15 # . 

CPlusPlusBegin 
$Inc 

namespace 
{ 

20 class SCIass i 

{ 

// Array types for parameters storage: 

SParamAry Types 

public; 

25 virtual void preExecQ; 

virtual void execQ; 
virtual void postExecQ; 
SParamFns 
//... 

30 private: 

double m_someVar; 

SParamAttrs 

//... 

}; 

35 // ... 

SParamlmpls 

} // End namespace 
CPlusPlusEnd 

[0319] There are several classes implementing the IFlowable interface. These include: 
40 ■ 1 . Flows for program loading which will check whether a test plan can be 

executed within the current tester configuration. 

2. Flows for pattern loading which will load specific patterns and pattern lists. 

3. Flows for initialization which will put hardware and software in a known 
state, load global variables, and do other initialization and validation 

45 functions. 
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4. Other generally useful test flows. 
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C7. Custom Types 

[0320] The discussion on Test class parameterization earlier only allowed for test class 
parameters to be of known types, viz., elementary types and tester-defined types such as 
5 PLists, and TestConditions. For user flexibility, it is important to provide type extensibility, 
whereby types (that are unknown a-priori to the compiler) can be created and used. 
Custom types (CTs) will be defined in the Custom Types. These can be used to define 
types corresponding to C-language structs (also referred to as Plain Old Data types, or 
PODs, which are quite different from their namesakes in C++) as well as for types 
10 corresponding to C-language typedefs for function signatures. A separate file with user 
types will have the extension .ctyp. Here is an example of a user types declaration in 
accordance with the preferred embodiment of the present invention: 

# 

# File MyCustomTypes.ctyp 



15 # 

Version 1.0.0; 

CustomTypes 

20 { 

# A structured Plain-Old-Data type 
Pod Foo 

{ 

String SI ; # String is a standard type 
25 Integer II; # ... and so is Integer 

String S2; 

} 

# Another structured type using Foo 
30 Pod Bar 

{ 

Foo Fool; 
String SI; 
Foo Foo2; 
35 } . . 

# 

# A pointer to a function. 

# Return type: Integer 

40 # Parameters: Integer, Integer 

# 

Routine BinaryOp(Integer, Integer) Returns Integer; 
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# 

# Another pointer to a fUnction. 

# Return type: Void 
5 # Parameter: Integer 

# 

Routine UnaryOp(Integer) Returns Void; 

# 

10 # A pointer to a function that takes 

# no parameters and does not return a value. 
# 

Routine NullaryOpQ Returns Void; 

} 

15 

C++ for Custom Types 

[0321] The CustomTypes declaration presented above will be translated by the 

compiler into the following C++ code: 

namespace CustomTypes 
20 { 

struct Foo 

{ 

Tester:: String SI; 
int II; 
25 Tester:: String S2 

}; 

struct Bar 
{ 

Foo Fool; 
30 Tester:: String SI; 

Foo Foo2; 

}; 

typedef int (*BinaryOp) (int&, int&); 
typedef void (*UnaryOp)(int); 
35 typedef void (*NullaryOp)(); 

} 

[0322] Objects of these types can be passed to Test classes as parameters, as shown 
next. 

Using Custom Types as Test Class Parameters 
40 [0323] Consider the case where the user has an extension to a test, which needs to be 
initialized with — in addition to pattern lists and test conditions — other class objects, as 
well as arbitrary (i.e., user-defined) objects that are defined within a file containing Custom 
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Types (i.e., a .ctyp file). For example, suppose the user wants to use the CTs defined in the 
file MyTestCTs.ctyp: 

# File MyTesetCTs.ctyp 
Version 1.0; 

5 

CustomTypes 

{ 

Pod Foo 

{ 

10 String name; 

PList pattemList; 

} 

Pod Bar 

15 , { 

Foo someFoo; 
Double dVal; 

} 

20 Routine BinaryOp(Integer, Integer) return Integer; 

} 

[0324] All that the user needs to do to use the above types is import the above file in 
his test class pre-header. Since the compiler interprets CTs that are so defined, the 
definitions for Foo and Bar are therefore available to it when it is processing the test class 
25 pre-header. Moreover, the compiler defines two C-language structs, struct Foo and struct 

Bar, corresponding respectively to the types Foo and Bar above, the definitions for which 
are placed in the file myTestCTs.h. The Import statement for myTestCTs.ctt causes the 
file myTestCTs.h to be #include-d in the generated test class C++ header. The following 
example illustrates this process. First, consider the declaration for the test in the test plan 
30 (the declarations for pattern lists and test conditions have been oniitted for clarity): 

Import MyFunctions.ph; 
Import MyCustomTypes.ctyp; 

35 # The Custom Vars block defines variables of the Custom 

# types defined earlier. 
CustomVars 

{ 

40 Bar bar! = 

{ 

{ "This is a Foo", somePatList }, # someFoo 
3.14159 #dVal 
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} 
# 

# A function object that is a binary operator. 

# The name on the right hand side of the assignment 

# is a routine declared in MyFunctions, for which, 

# of course, the user has to provide an implementation. 
# 

BinaryOp bopl = MyFunctions.Min; 



Test MyFancyTest MyTestl 
{ 

BarParam = barl ; 
BinaryOpParam = bopl ; 

} 

[0325] In the above example, a CustomVars block is included in a test plan. A 
separate file with customization variables will have the extension .cvar. The user would 
write a pre-header for MyFancyTest that supports the above parameterization as follows 
(the parameterization declarations for pattern lists and test conditions have been omitted 
for clarity): 

# 

# File MyFancyTest.ph 
# 

# Parameterization specification pre-header for MyFancyTest 
# 

Version 1.0.2; 

Import MyCustomTypes.ctyp; # For CTi used in MyFancyTest 

Import FimctionalTest.ph; # For base class FunctionalTest 

TestCIass = MyFancyTest; # The name of this test class 

PublicBases = FunctionalTest; # List of public base classes 

# The parameters list: 
Parameters 

{ 

# The following declaration specifies that a MyFancyTest has 

# - an optional array of parameters of custom type Bar 

# - [represented by C++ type CustomTypes::Bar] 

# - stored in a member named m barsArray 

# - a fiinction to set it named addBarParam. 

# An implementation will be generated for addBarParam. 
Bar BarParam 
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{ 

Cardinality = 0-n; 

Attribute mbarsArray; 

SetFunction = addBarParam [Implement]; 

} 

# The following declaration specifies that a MyFancyTest has 

# - an optional parameter of custom type BinaryOp 

# - [represented by C++ type CustomTypes::BinaryOp] 

# - stored in a member named m_binaryOp 

# - a function to set it named setBinaryOpParam. 

# An implementation will be generated for setBinaryOpParam. 
BinaryOp BinaryOpParam 

{ 

Cardinality = 0-1; 

Attribute = mbinaryOp; 

SetFunction = setBinaryOpParam [Implement]; 

} 

} 



CPlusPlusBegin 
Sine 

namespace 
{ 

class SClass 
{ 

SParamAry Types 

pubHc: 

virtual void preExec(); 

virtual void execQ; 

virtual void postExecQ; 

SParamFns 

//... 
private: 

double m someVar; 

SParamAttrs 

//... 

}; 

// ... 

SParamlmpls 

} // End namespace 
CPlusPlusEnd 



C++ for Custom Test Classes using Custom Types 
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[0326] Finally, once the compiler has processed this pre-header file, it will create the 

following C++ header file for the MyFancyTest class, MyFancyTest.h: 

#include <MyCustomTypes.h> 
#include <ITest.h> 
#include <FunctionalTest.h> 

namespace 
{ 

class MyFancyTest : public ITest, 

public FunctionalTest 

{ 

public: 

typedcf std::vector<CustoinTypes::Bar *> BarAry_t; 

public: 

virtual void preExecQ; 
virtual void exec(); 
virtual void postExecQ; 

public: 

void setName(OFC String &name); # Automatic for all tests 

void setPattemTree(PattemTree *); 

void add rcstCondition(TestCondition *); 

void addBarParain(Custoni Types: :Bar *); 

void setBinaryOpParain(CustoiiiTypes::BinaryOp *)', 

private: 

double m_someVar; 

private: 

OFCString m_name; # Automatic for all tests 
PattemTree *m_pPatList; 
TestConditionPtrsAry_t ra_testCondnsArray; 
. BarAry_t m_barsArray; 
BinaryOp *in_binaryOp; 

}; // End class MyFancyTest 



inline void 

MyFancyTest: :addBarParam(CustoinTypes::Bar *arg) 
{ 

m_barsArray.push_back(arg); 
return; 

} 

inline void 

MyFancyTest: :setBinaryOpParam(CustomTypes:: BinaryOp *arg) 
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{ 

m_binaryOp = arg; 
return; 

} 

} // End namespace 
C8. Parameterization 

[0327] As seen above, a pre-header for a Test class, custom Flowable class, or custom 
function defmitions offers limited introspection into the class/functions through a 
parameterization specification section. The compiler uses this section to generate the 
parameterization interface for the class/function (and generate the class/function header 
itself). For Test classes and Flowable classes, it also uses this section to subsequently 
generate the calls in the Test Plan code to initialize an instance of that class. The following 
points concerning pre-headers and corresponding declaration should be noted: 

1 . Every Test or custom Flowable class definition is preferably specified in a 
pre-header. The Parameters block in the pre-header is preferably the only 
place where the parameters list for such a class can be specified. (Thus, as a 
corollary, the "standard" parameters for a Test, such as pattern list and test 
condition specifications, also need to be included in the pre-header' s 
Parameters block; this allows all parameters, standard and CTs, to be treated 
uniformly.) 

2. All parameters defined as non-optional (i.e., with a non-zero cardinality) in 
the pre-header for a Test or Flowable class should be initialized in the Test 
block or Flowable block declaration for an instance of that class. 

3. The objects used for initialization of parameters in the Test/Flowable block 
should have been defined previously. 

4. The replacement indicators $Class, $Inc, SParamAryTypes, SParamFns, 
$ParamAttrs and SParamlmpls must appear at the exact locations within the 
user code section of the pre-header that the user intends the corresponding 
generated code to be inserted at in the generated class header file. These 
should appear exactly once, since specific code is generated for each. 
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5. The name of a parameter specification in the Parameters block of the pre- 
header (such as PListParam, TestConditionParam or BarParam in the 
examples above) is the name of the parameter to be used in the declaration 
of an instance of that class. 

5 6. The following are the semantics of the descriptors used in a parameter 

specification: 

a. Cardinality: This indicates the number of parameters of this type that 
will be supported. The following are the possible values in one 
embodiment: 

10 i. 1: This parameter is mandatory, and should be specified 

exactly once. This parameter will be maintained as a pointer 
to an object of the type of the parameter. 

ii 0-1: This parameter is optional; if specified, it must be 
specified only once. This parameter will be maintained as a 

1 5 pointer to an object of the type of the parameter. 

iii 1-n: This parameter is mandatory. Moreover, multiple 
values can be specified for this. The values will be stored in 
the order of specification. 

iv 0-n: This parameter is optional. Multiple values can be 
20 specified for this. The values will be stored in the order of 

specification. 

Note that for Q and () above, all specified values will be stored in an 
STL vectoro, templated on a pointer to the type of the parameter. 
The type of this vector will be defined and inserted at the point 
25 indicated by SParamAryTypes. The access level for these type 

definitions is always public. 



b. 



Attribute: The name of the C++ variable to use as the store for 
parameter value(s) of this type. The name will be reproduced 
verbatim, as a private data member of the C++ class, and must 
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conform to the requirements for a C++ identifier. Note that the type 
of this attribute is: 

i. A pointer to the type of the parameter, if only single values 
are permitted; 

ii. An STL vectoro, templated on a pointer to the type of the 
parameter, if multiple values are permitted (see () above). 

Note that the attributes hold references to objects created and 
populated by the Test Plan, and do not own these objects. The 
lifetime of the objects are always managed by the Test Plan itself. 

c. SetFunction: The name of the function to use for setting a value for 
this parameter. The following points should be noted: 

i. The name will be reproduced verbatim, and hence, must 
conform to C-H- language requirements. 

ii. The access level of the function is always public. 

iii. The return type is always void. 

iv. The function always takes only a single argument, of type 
pointer-to-parameter-type. 

[0328] Note that a value is always set singly; i.e., for parameters that allow 
specification of multiple values, the generated code in the Test Plan will call this function 
repeatedly, once for every value specified, each of which will be added to an STL vector 
(as described above). 

[0329] The optional keyword "[implement]" following the function name indicates that 
a trivial implementation for this function will be made available as an inline method in the 
class header (inserted at the point indicated by $ParamImpls). Otherwise, the user is 
responsible for providing an implementation of the function. 

d. Description: A string literal that is a tooltip which will be used by a 
GUI tool to provide help during runtime modification of this 
parameter. The C++ member function generated in the custom class 
for a parameter named Xxx will be 

String getXxxDescription () const; 
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The function will return the specified string. 
Test Plan Example with Customization 

[0330] Shown below is the test plan example embellished with some customization: 

# 

# File MyCustomizedTestPlan.tpl 



# .. 

Version 0.1; 

10 # 

# Imports as before ... 

# The following import is implicit, but can be explicitly 

# provided. 

1 5 Import FimctionalTest.ph; 

# Import for MyFlowables, MyFunctions and Functions 
Import MyFlowables.ph; 

Import MyFunctions .ph; 
20 Import Functions.ph; 



# Start of the test plan 

# 

25 TestPIan Sample; 

# This block defines Pattern Lists file-qualified names and 

# Pattern List variables that are used in Test declarations. 

# The file-qualified names refer to pattern lists in the named 
30 # files. The variables refer to String variables which will 

# hold the pattern list names at run time. User defined Flowable 

# objects could set the values of these variables tlirough an 

# APL 
PListDefs 

35 { 

# File qualified pattern list names 

pllA.plistpatlAlist, 

pl2A.plist:pat2AList, 

40 # Pattern list variables 

plistXxx, 
plistYyy, 
plistZzz 



45 
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# SocketDef, UserVars declaration as before ... 

# Declarations of TestConditions TClMin, TClTyp, TCI Max, 

# TC2Min, TC2Typ, TC2Max as before ... 

5 

# 

# Declare a FunctionalTest. "FunctionalTest" refers to a C++ 

# test class that runs the test, and returns a 0, 1 or 2 as 

# a Result. The Test Condition Group TCGl is selected with 
10 # the "min" selector by referring to the TC 1 Min TestCondition. 

# 

# Note that compiler can compile this because of the imported 

# FunctionalTest.ph file. 

# 

1 5 Test FunctionalTest MyFunctionalTest 1 Min 

{ 

PListParam = patl AList; 
TestConditionParam = TClMin; 

} 

20 

# 

# Additional FunctionalTest declarations for the following, as before 

# MyFunctionalTest ITyp 

# MyFunctionalTest 1 Max 
25 # MyFunctionalTest2Min 

# MyFunctionalTest2Typ 

# MyFunctionalTest2Max 
# 

30 # Here is a declaration of MyFlowable. It uses a PattemList variable 

# plistXxx which is initialized by the flowable prior to use here. 
# 

# Compiler can compile this because of the imported MyFlowables.ph 

file: 

35 Flowable MyFlowable MyFlowable 1 

{ 

Intl = 10; 
Int2 = 20; 

Stringltem = "Hello World"; 
40 PListParam = plistXxx; 

} 

# Counters for PassCount and FailCount as before ... 

45 # Flows as before. Flows FIowTestl and FlowTest2 are 

# unchanged from the previous example. 
Flow FIowTestl 

{ 

#... 
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10 



15 



20 



25 



30 



35 



40 



45 



Flow FlowTest2 
{ 

#... 

} 
# 

# Now FlowMain, a main flow, can be presented. It 

# implements a finite state machine that calls FlowTestl 

# and FlowTest2 as below: 

# 

# Result 0 Result 1 
# 

# FlowMain_l FlowMain_2 return 1 

# FlowMain_2 FlowMain_3 return 1 

# FlowMain S FlowMain_4 return 1 

# FlowMain_4 FlowMain_5 return 1 

# FlowMain_5 return 0 return 1 
# 

U Where the IFlowables nm by each Flowltem are: 
# 

# Flowltem IFlowable that is run 
# 

# 

# 
# 

Flow FlowMain 
{ 

# 

# The first declared flow is the initial flow to be 

# executed. It goes to FlowMain lnitializationFlow 

# on success, and returns 1 on failure. 
# 

Flowltem FlowMain_l MyFlowablel 



FlowMain_ 

FlowMain_ 

FlowMain 

FlowMain_ 

FlowMain 



MyFlowablel 

DatalogStartFiow 

FlowTestl 

FlowTest2 

DatalogStopFlow 



{ 



Result 0 

{ 

Property PassFail = "Pass"; 
IncrementCounters PassCount; 
'# A user function call 

MyFunctions.Print ("Passed MyFlowablel", 
Functions.GetDUTIDQ); 

GoTo FlowMain_2; 

} 



Result 1 
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{ 

Property PassFail = "Fail"; 
IncrementCounters FailCount; 

# A user function call 

MyFunctions.PrintC'Failed MyFlowabie 1 ", 

Functions.GetDUTIDQ); 
SetBin SoftBins."3GHzLeakage"; 
Return 1; 

} 

} 
# 

# Goes to FlowMain_3 on success 

# and returns 1 on failure. 
# 

Flowltem FlowMain_2 DatalogStartFlow 
{ 

Result 0 

{ 

Property PassFail = "Pass"; 
IncrementCounters PassCount; 

# A user function call 

MyFunctions.Print("Passed DatalogStartFlow", 

Functions.GetDUTIDQ); 
GoTo FlowMain_3; 

} 

Result 1 

{ 

Property PassFail = "Fail"; 
IncrementCounters FailCount; 
MyFunctions.Print("Failed DatalogStartFlow", 
Functions.GetDUTIDO); 

Return 1; 

} 

} 

# This Flowltem calls the previously defined FlowTestl 
Flowltem FlowMain_3 FlowTestl 

{ 

Result 0 

{ 

Property PassFail - "Pass"; 
IncrementCounters PassCount; 

# A user function call 
MyFunctions.Print("Passed FlowTestl ", 

Functions.GetDUTIDO); 
GoTo FlowMain_4; 

} 
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Result 1 

{ 

Property PassFail = "Fail"; 
5 IncrementCounters FailCount; 

# A user function call 
MyFunctions.Print("Failed FlowTest 1 ", 

Functions.GetDUTIDO); 
SetBin SoftBins/'SGHzCacheFail"; 
10 Return 1; 

} 

} 

# This Flowltem calls the previously defined FlowTest2 
1 5 Flowltetn FlowMain_4 FlowTest2 

{ 

Result 0 

{ 

Property PassFail = "Pass"; 
20 IncrementCounters PassCount; 

# A user function call 

, MyFunctions.PrintC'Passed FlowTest2", 

Functions.GetDUTIDO); 
GoTo FlowMain_5; 

25 } 

Result 1 

# FlowTest 1 passed, but FlowTest2 failed 
30 Property PassFail = "Fail"; 

IncrementCounters FailCount; 

# A user function call 
MyFunctions.PrintC'Failed FlowTest2", 

Functions.GetDUTIDO); 
35 SetBin SoftBins."3GHzSBFTFair'; 

Return 1; 

} 

} 

40 Flowltem FlowMain S DatalogStopFlow 

{ 

Result 0 

{ 

# All Passed! 

45 Property PassFail = "Pass"; 

IncrementCounters PassCount; 

# A user function call 
MyFunctions.PrintC'Passed all ! ", 

Functions.GetDUTIDO); 
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SetBin SoftBins."3GHzAllPass"; 
Return 0; 

} 

5 Result 1 

{ 

# FlowTestl and FlowTest2 passed, 

# but DatalogStopFlow failed 
Property PassFail = "Fail"; 

10 IncrementCounters FailCount; 

# A user function call 

MyI;unctions.Print("FaiIed DatalogStopFlow", 
Functions.GetDUTIDO); 

Return 1; 

15 } 



} 



} 



[0331] The following points need to be noted about the above code: 
20 1 . The PListDefs section here has some PList names and also some PList 

variables. The PList names are names that can directly be used in tests. 
The PList variables are variables which can be used in tests, and whose 
value is bound at runtime to actual PLists by code in a customized Flowable. 

2. The PListDefs section is optional. If not present, its contents will be 

25 inferred by compiler from the various Test declarations. If present, it must 

declare all of the used PList parameters of Tests, though it may declare 
more. 

3. A runtime API will be available to assign values to PList variables. The 
TestPlan class will have a function: 

30 Status SetPListVariable(const Tester: :String& varName, 

const Tester: :String& fileQualifiedPListName); 
The Flowable will be able to use the above function to bind a PListVariable 
to a particular PList. 

4. User flinctions and functions can be called in Flowltems just prior to a 
35 transition, which is either a transfer of control to another Flowltem, or a 

return. 



C++ for User Function Calls 
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[0332] With the exception of invoking custom function calls in flows, C++ code that 

would be generated by the compiler has been shown for the various customization 

techniques presented earlier. User function calls in a Flowltem are preferably handled by 

an lUserCalls member of each Flow. Each Flow preferably has a member of the interface 

5 lUserCalls which exports a single virtual member function, as shown below: 

class lUserCalls 
{ 

public: 

virtual void exec(const String& flowItemName, 
1 0 unsigned int result) = 0; 

}; 

[0333] When a Flow with user function calls is encoimtered, the Flow gets populated 
with an instance of a class that implements the above interface. For example, in FlowMain 
in the example in the flow will be populated with an instance of the following class: 

15 class FlowMain_UserCalls : public lUserCalls 

{ 

public: 

virtual void exec(const String& flowItemName, 
unsigned int result) 

20 { 

if (flowItemName == "FlowMain_l") 
{ 

//... 

} else if (flowItemName == "FlowMain_2") 
25 { 

//... 

} else if (flowItemName = "FlowMain_3") 
{ 

switch (result) 

30 { ■ 

case 0: 

MyFunctions::Print("Passed FlowTestl ", 

Functions: :GetDUTID()); 

return; 

35 case 1: 

MyFunctions: :Print("Failed FlowTest 1 ", 

Functions::GetDUTID()); 

return; 
default: 

40 return; 

} 

} 

else if (flowItemName == "FlowMain_4") 
{ 

45 // ... 
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} 

else if (flowItemName == "FlowMain_5") 
{ 

// ... 

5 } 

} 

}; 

[0334] The FlowItem::execute() operation knows the name of the flow item. Before it 
1 0 returns with the pointer to the next flow, it will call lUserCalls: :exec() for the enclosing 
flow, passing its own flow item name, and the value of the current result. This will cause 
the above code to be executed, invoking the needed user defined functions. 

C9. Test Program Compilation 

[033S] As explained above, the Test Plan description file specifies the objects used in a 
15 test plan and their relationships to one another. In one embodiment, this file is translated to 
the C++ code that will be executed on the Site Controller in the form of an implementation 
of a standard interface ITestPlan. This code can be packaged into a Windows dynamic 
link library (DLL) which can be loaded onto the Site Controller. The Test Program DLL is 
generated to have standard known entry points that the Site Controller software can use to 
20 generate and return the TestPlan object it contains. 

Construction from a Test Plan Description 

[0336] The process of conversion fi-om a test plan description to an implementation of 
ITestPlan is accomplished by the test program compiler 400. This process occurs in two 
phases: translation and compilation. 

25 [0337] In the translation phase 402, the compiler 400 processes a test plan file (and the 
various other files it imports), as well as the pre-headers for all the test types used in the 
test plan. In this phase, it creates the C++ code for the Test Plan object and the C++ 
headers for the test types encountered, along with all other supporting files, such as 
MSVC++ (Microsoft Visual C++) workspace and project files, DLL "boilerplate" code, etc. 

30 The compiler 400 inserts file and line directives into the generated code to ensure that 
compile-time error messages refer back to the appropriate location in the description file 
instead of pointing into the generated code. 
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[0338] In the compilation phase, which occurs after the compiler has created the 
necessary files, a standard compiler 404, such as an MSVC++ compiler, is invoked to 
compile the files and link them into a DLL. 

[0339] The compiler takes, as input, a valid test plan file (and all related files), and 
5 generates, as necessary, a TestPlan file and all other files represented by "Import" 

directives in the test plan file. In addition, it generates a MSVC++ '^Solution" to build the 
Test Plan DLL. For example, if the main file (MyTestPlan.tpl) included Timing 1 .tim to 
incorporate timing information, then the compiler would create (among others) the 
following files: 

10 MyTestPlan.h 
MyTestPlan.cpp 

Timing 1 .cpp 

MyTestPlan.sln (MSVC-h- "Solution" file) 
MyTestPlan.vcproj (MSVC++ "Project" file) 

15 

[0340] After all files are created (or updated), the compiler invokes the MSVC++ 
application, specifying the "Solution" it created, and builds the DLL. Any errors and/or 
warnings would be shown to the user. 

[0341] If, after building the Test Plan, the user made a change to Timing 1 .tim, the user 
20 would then invoke the compiler, passing it MyTestPlan.tpl. The compiler would recognize 
(by timestamp information) that the main test plan file is unchanged, so that 
MyTestPlan.h/.cpp would not be recreated. However, while processing the main test plan 
file, it would see that the Timing.tim file has changed. Therefore, it would recreate the 
Timingl ,cpp file, and invoke the MSVC++ application to rebuild the DLL. This avoids 
25 recompiling MyTestPlan.cpp, and only compiles Timingl .cpp and re-links the DLL. This 
approach will be especially useful in cutting down re-compile and re-link times for large 
test plans that take a significant amount of time to compile. 

D, Running the Test Program 

[0342] The Site Controller software loads the Test Program DLL into its process space 
30 and calls a "factory" fiinction within the DLL to create an instance of the Test Plan object. 
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Once the Test Plan object has been created, the Site Controller software can then execute 
the test plan or interact with it in any other way necessary. 

Non-Interactive Builds 

[0343] To most C++ software developers in the Windows environment building an 
application (or a DLL, or Library, etc) means bringing up a development environment (MS 
Visual C++, Borland C++, or similar), editing code, and (often) pressing a button to build 

the product. 

[0344] The test environment of an embodiment of the invention will have a similar set 
of activities. Test Plan developers will need to edit code and build their Test Plans. 
However, tester will not require the Test Plan developer to bring up a C++ development 
envirormient in order to produce the resulting Test Plan DLL. 

[0345] In order to accomplish this the present invention employs the concept of a non- 
interactive build. A non-interactive build is defined as a build that uses MS Visual C++ in 
a non-interactive mode. Note that this still allows other tools to be used interactively to 
manage such a build. The only implication is that Visual C++ is used non-interactively. 

Assumed Environment 

[0346] Certain assumptions are made about the user's environment. The assumptions 
are: 

1 . The Test Plan developer will be developing his Test Plan according to 
above methods and rules. 

2. The Test Plan developer may not have a expert level knowledge of C++. 

3. The Test Plan developer will have access to command-line tools or GUI 
tools to convert file(s) to a Test Plan DLL. 

Building Applications Without Buttons 

[0347] Working with MS Visual Studio non-interactively requires one of two 
approaches. The first (and simplest) is to use the command-line interface. The second 
(and more flexible) is to use the Automation interface. This section describes both 
approaches. 



Creating the Project 
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[0348] In order to use Visual Studio non-interactively one should start with a working 
Solution which contains one or more valid Projects. Unfortunately, this is the one task that 
cannot be accomplished from either a command-line or Automation approach. Neither 
method provides a mechanism for project creation. However, projects and solutions for 
5 Visual Studio can be created from a template. Therefore, given a project name and a 
template to start from we can create a solution/project for Visual Studio. 

Populating the Project 

[0349] Adding new files to the produced project uses the Visual Studio Automation 
model since the command-line does not support this. We provides two Visual Studio 
10 macros to add new and existing files to a project. Similar code could be used by an 
external script using an ActiveScript Engine (such as VBScript, JScript, ActivePerl, 
ActivePython, etc) to perform the same tasks.Therefore, our code geiieration tools could 
create new files and, using the Automation Model, add them to the existing Visual Studio 
project. After the files are created they can be updated as necessary by the tools. 

1 5 Building the Project 

[0350] Once we have a solution and project in place there are several options to using 
Visual Studio non-interactively to build the Test Plan. The simplest option is to invoke it 
from the command-line. Such a command-line would look like: 
devenv solutionFile /build solutionCfg 

20 [0351] where solutionFile is a Visual Studio solution file and solutionCfg is a specific 
configuration applicable to the projects within the solution. Another solution is to use the 
Visual Studio Object Model for Automation. This allows a finer grain of control over the 
build and configuration process. As mentioned above, it contains a listing of a Perl script 
to build a project from the command line. This program reads a configuration file which 

25 specifies projects and configurations to build (as well as other information about the 

projects) and builds them all using the Automation Model. Look at the uses of the $msdev 
object in this script for examples of how to use Automation objects in a script. 

Debugger Support 

[0352] In order for developers of Test classes to verify and debug their work, they need 
30 access to a debugger that allows them to break into the Site Controller and step through 
their code. Since the code generated by the compiler is C-H- which is compiled by 
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MSVC++, we use the MSVC++ debugger to debug Test class implementations. Note that 
this feature is meant only for Test class developers or others who work directly in C++. 
Other mechanisms will be provided to test engineers who wish to debug or step through 
the operation of a Test Program without referring directly to the generated C++ code. 

5 System Software Environment 

[0353] This section describes the general software enviromnent for the Tester: the 

locations for the files required by user test plans, mechanisms for specifying alternate 
locations for such files, and the methods for specifying the locations of the test plans and 
module control software. 

Environment Required by Test Plans 

[0354] System standard locations, as well as the runtime configuration of the search 
paths for , 

1 . pattern lists, 

2. patterns, 

3. timing data, and 

4. test class DLLs 

[0355] required by a test plan, may be configured by "environment" variables, as 
specified by environment configuration files. These are text files, with a simple syntax 
such as: 

Tester_PATOBJ_PATH = "pattems\data;D:\projects\SC23\patterns\data" 

[0356] The advantage of having such "environments" defined in text files instead of 
through native OS-supported environment variables is that the implementation is then not 
limited by the common restrictions that OS-supported environment variables have, such as 
maximum string lengths, etc. The following "environment" (setup) variables will be used 
for the entities listed above: 

Pattern lists: Tester_PATLIST_PATH. 

Pattern object files: Tester_PATOBJ_PATH. 

Pattern source files: Tester_PATSRC_PATH (this is optional; please see). 
Timing data files: Tester_TIMING_PATH. 



15 



20 
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Test class DLLs: Tester_TEST_CLASS_LIBPATH. 
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[0357] In order to support special cases, while maintaining usefUl default behavior, we 
provide three levels of configuration. These are described in increasing order of 
precedence: 

[0358] First, a system environment setup file, 

$Tester_INSTALLATION_ROOT\cfg\setups\Setup.env, will specify the default values of 
"environment" variables. If no other configuration mechanism is available, this file will be 
required. In general, it will be available for all test plans run on the system. This file is 
created by the Installation and Configuration Management (ICM) system during 
installation, with input from the installer to assign the default values for the three variables 
mentioned above. (Note that besides the system defaults for the above three variables, this 
file will also contain the system defauhs for certain other tester "environment" variables, as 
described in the foUowdng sub-section.) 

[0359] Second, an environment setup file may be specified by the user as a runtime 
argument to the test plan. The variables in this runtime configuration will take precedence 
over default definitions. 

[0360] Finally, a test plan may use a special block to specify the environment variables 
to be used in its execution. Variables defined in the test plan will take precedence over 
those in the default system file or the user-defined file. 

[0361] In general, all necessary variables should be defined through one of the 
mechanisms described above. If a variable is not defined, a runtime error will occur. 

Other Environment Setups 

[0362] Besides the "environment" variables that are required by user test plans, the 
following two "envirormient" variables are required by the test environment: 

1. Tester_TEST_PLAN_LIBPATH: This specifies the search path that 
the System Controller will use for finding a user test plan DLL that 
should be loaded. Note that the same search path will also be used 
for finding user pin description and socket files. The default value 
for this variable, specified during installation time to the ICM, is 
stored by the ICM in the file 

$Tester_INSTALLATION_ROOT\cfg\setups\Setup.env. 
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2. Tester_MODULE_LIBPATH: This specifies the search path that 
the system will use to load vendor-provided hardware module 
control software DLLs. This information, extracted from the 
Configuration Management Database (CMD), is also stored in the 
file $Tester_INSTALLATION_ROOT\cfg\setups\Setup.env by the 
ICM. 

[0363] Note that while a user can override the value given in the Setup.env file for the 
Tester TEST PLAN^LIBPATH variable, the value given in the Setup.env file for the 
Tester_MODULE_LIBPATH should not be changed by the user unless the user wants to 
explicitly change the search path for the vendor-provided hardware module control 
software DLLs. 

Search Path Specification Semantics 

[0364] The following points should be noted about the "environment" variables that 
specify search paths:. 

1 . Each should be a semicolon(";")-separated list of directory names 
that the system will search to find a referenced file of a particular 
type. 

2. After initial system lookup of the value of such an "environment" 
variable, any changes made by the user to its value (for example, by 
editing an environment configuration file) will only be registered by 
the system when the user explicitly "informs" the system of the need 
to do so. 

3. Relative pathnames in the search paths will be interpreted as being 
relative to a particular setting of a related environment variable (that 
provides the functionality of defining a root), as paths relative to the 
"current working directory" (CWD) could lead to ambiguous results, 
since the notion of a CWD in a distributed environment — such as 
the one in which the tester works — might not be what the user 
intuitively expects it to be. This related environment variable, which 
designates the root that all relative pathnames in the search paths 
will be assumed to be relative to, is the 
"Tester_INSTALLATION_ROOT" variable, which gives the 
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location of the top-level (i.e., "root") directory of the tester 
installation on a user's system. 

4. The directory entries cannot contain the characters in the set 
[V:*?"o|;]; note that except for the semicolon (";"), all the other 

5 characters in this set are illegal in Windows file names. The 

semicolon (";") should not be used in search path entries, since it is 
used to demarcate entries in the search path. Note that pathnames 
can have embedded whitespaces, but all whitespaces occurring 
immediately before and after a pathname (i.e., before the first and 
1 0 after the last non-whitespace character in the pathname) will not be 

considered to be part of the pathname, and will be ignored. 

5. The search path directories will be searched in the order they are 
encountered in the definition. The first occurrence of a file will be 
the one chosen. 
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£. Test Patterns 

[0365] The efficient managenxent, handling and loading of a very large set of test 
pattern files is an important architectural aspect of the framework of an embodiment of the 
invention. The idea of hierarchical pattern lists is regarded as being an effective tool in 
5 providing tractable conceptualization and ease of use of the system to the end user. 

[0366] The stimulus to a DUT is made available to the test system through test vectors. 
Vectors can generally be categorized as sequential (or linear), scan or Algorithmic Pattern 
Generator (APG)-derived. In the system of an embodiment of the invention, test vectors 
are organized in terms of patterns that are applied to the DUT at test time. A pattern is 

10 represented by a Pattern object in the user's test program. In the system, patterns are 

organized in pattern lists, represented programmatically by pattern list objects. A Pattern 
List object represents an ordered list of patterns or other pattern lists. The ordering is 
implicit in the order of declaration of the list components. Note that if only a single pattern 
is needed, it is required to be encapsulated in a list by itself 

15 [0367] A pattern list object in the user's test program is associated with a pattern list 
file on disk, which contains the actual definition of the pattern list. The contents of a 
pattern list are thus dynamically determined by the contents of the associated disk file 
(more will be said about this later). 

[0368] The definition of a pattern list provides an explicit name for the pattern list, and 
20 identifies an ordered list of patterns and/or other pattern lists through file name 

associations. It also provides for the specification of execution options, which will be 
described in detail after the pattem objects have been described, since the options can be 
applied to both pattem lists and patterns. The pattem list should follow the following 
rules: 

25 file-contents : 

version-info global-pattern-list-definitions 

version-info : 

Version version-identifier ; 

global-pattern-list-definitions : 

30 global-pattern-list-definition 

global-pattern-list-definitions global-pattern-list-definition 

global-pattern-list-definition : 

global-pattern-list-declaration { list-block } 

global-pattern-list-declaration : 
35 G\ohaXP\j\%t pattern-list-name options opt 
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list-block : 
list-entry 

list-block list-entry 
list-entry : 

5 pattern-entry ; 

pattern-list-entry ; 
global-pattern-list-definition ; 
local-pattern-list-definition ; 

pattern-entry : 
10 Pat pattern-name optionsgp, 

pattern-list-entry : 

PList pattern-list-reference optionsopt 

pattern-list-reference : 

pattern-list-qualified-name 
1 5 file-name ': ' pattern-list-qualified-name 

pattern-list-qualified-name : 
patter n-l ist-name 

pattern-list-qualified-name '. 'pattern-list-name 

local-pattern-list-definition : 
20 local-pattern-list-declaration { list-block } 

local-pattern-list-declaration : 

LocalPList pattern-list-name optionsopi 

options : 
option 

25 options option 

option : 

[ option-definition ] 

option-definition ; 

option-name oplion-parametersopi 

30 option-parameters : 

option-parameter 

option-parameters ',' option-parameter 
[0369] The following are the descriptions of undefined non-terminals used above: 

1 . version-identifier : A sequence of one or more characters from the set [0-9.], 
35 where the first character must be a digit. 

2. name : A sequence of one or more characters from the set [a-zA-Z_0-9], 
where the first character must be firom the set [a-zA-Z_]. 

3. pattern-list-name : A sequence of one or more characters from the set [a- 
zA-Z_0-9], where the first character must be from the set [a-zA-Z_]. 
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4. file-name :A valid Windows file name (must be enclosed in double quotes if 
any white-spaces are contained in the file name). Note that this should be a 
simple file name, i.e., it should not have a directory component. A pattern- 
list-reference can be either internal referring to a pattern list in the same file, 
or external referring to one in another file. External references need to be 
qualified by a file-name. 

5. option-name : A sequence of one or more characters fi-om the set [a-zA- 
Z_0-9], where the first character must be firom the set [a-zA-Z_]. 

6. option-parameter : A sequence of one or more characters from the set [a- 
zA-Z_0-9]. 

[0370] Pattern list files support comments, which are meant to be ignored by a pattern 
list file parser. Comments start wdth the character, and extend to the end of the line. 

El. Rules for Pattern List 

[0371] The static or compile-time rules for pattern lists govern the declaration and 
resolution of names. Names in the pattern list language are declared by global-pattem-list- 
definitions and local-pattem-list-definitions. They are referenced by pattern-list-references. 
Below are some rules governing these declarations and references. 

1 . A global-pattem-list-definition or a local-pattem-list-definition declares the 
name of a pattern list. A pattem-list-reference references the name of a 
declared pattern list. The names of global pattern lists are globally known. 
The names of local pattern lists are known only in the list-block in which 
they are declared. They can be referred to without qualification directly in 
that list block. In a more deeply nested declaration, a local pattern list will 
need to be referred to by a qualified name. 

2. Local pattern list names are known within the scope of an enclosing pattern 
list, and global pattern list names known within the scope of the system. 
For example: 

GlobalPList Gl 
{ 

LocalPListLl 
{ 

LocalPList L2 
{ 
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} 

GlobalPList G2 
5 { 

} 

PList L2; # OK. Name L2 is known in this scope 
10 PList G2 # OK. Name G2 is global 

} 

PList L2; # Error. Name L2 is not known here. 

PList LI .L2; # OK. Name LI is known here. L2 is known by 
1 5 # qualification. 

PList G 1 .L 1 .L2; # OK. Qualification by G 1 is not needed but 

# is allowed. 
PList G2; # OK. Name G2 is global 

} 

20 3. Global pattern lists may be defined at an outermost level in a pattern list file, 

or may be defined as nested within an enclosing pattern list. The nesting is 
merely a convenience, however. They are conceptually defined as global 
pattern lists at the outermost level in the file. A nested global pattern list is 
semantically equivalent to an outermost (non-nested) global pattern list of 

25 the same name. So for example: 

GlobalPList Gl 
{ 

GlobalPList G2 ... 

}■ 

30 is semantically equivalent to: 

GlobalPList Gl 
{ 

PList G2; # References G2 

} 

35 

GlobalPList G2 ... 

4. All global pattern lists are uniquely named. 

GlobalPList Gl 
{ 

40 # Note that this is as if declared at the outermost level 

# with a reference to it right here. 
GlobalPList G2 
{ 
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} 

} 

# This declaration will be an error in this or any other file, 
5 # as the name G2 is already taken. 

GlobalPList G2 # Error. Global name G2 is taken. 
{ 

} 

10 5. Local pattern lists are always have their definitions nested within an 

enclosing pattern list which also determines the scope of the name of the 
local pattern list. Local pattern lists are uniquely named within their 
enclosing pattern list. Local pattern lists are syntactically disallowed from 
occurring at the outermost level in a pattern list file. 

15 GlobalPList Gl 

{ 

LocalPListLl 

{ 

} 

20 

LocalPList L2 
{ 

LocalPList LI # OK. No local name LI is declared 
directly 

25 # in the enclosing scope defined by L2. 

{ 
} 

PList LI; # OK. Refers to L 1 declared in L2 
30 PList Gl .LI ; # OK. Refers to LI declared in Gl . 

} 

# Error. Redeclaring name LI when the enclosing 
scope 

35 # defined by Gl already has an LI declared in it. 

LocalPListLl; 
{ 
} 

40 } 

6. Each pattern list file contains the definition for one or more global pattern 
lists. This follows directly from the syntax. The outermost level is a 
global-pattem-list-definition, and there must be at least one of them. 
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7. The pattern-name is a reference to a pattern, following the Pat keyword.. It 
references a pattern that is in a pattern file whose name is obtained by 
concatenating a suffix .pat to the pattern name. The file denotes a file that 
will be obtained along a search path defined for patterns. 

5 8. A pattem-list-reference is a reference to a pattern list following the PList 

keyword. The reference consists of an optional filename followed by a 
qualified pattern list name which is just a list of names separated by dots. 
So, for instance, the following could be a pattern-list-reference: 

PList foo.plist:Gl.Ll.L2.L3; 

10 referring to a local pattern list L3 nested in L2 nested in LI nested in a 

global pattern list Gl that is in a file foo.plist. The leftmost name segment 
in the above name is 01. 

[0372] The leftmost name segment must resolve to either a global pattern list, or else to 
a local pattern list that is visible from the point of reference. 
1 5 [0373] Name resolution of a pattem-list-reference proceeds as follows: 

1 . Each name segment resolves to a name declared in the context of the 
prefix before it. 

2. If there is a file qualification, the leftmost name segment resolves to 
a global pattern list declared in the named file. 

20 3. If there is no file qualification, the leftmost name could resolve to a 

local pattern list within the enclosing scope and if that fails then the 
next enclosing scope, and so on, up to an enclosing global scope. 

4. Limiting the searching of scopes to the closest enclosing global 
scope is needed in order to preserve the semantics of global scopes 

25 as if they were declared at the outermost level in the pattern list file. 

If the nested global scope was (equivalently) textually declared at 
the outermost level, the name resolution search would terminate 
after examining its scope. 

5. If the reference has not been resolved by the prior steps, then the 

30 leftmost name segment can be resolved to a global pattern list within 

this same file. 
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6. If the reference has not been resolved by the prior steps, then the 
leftmost name segment can be resolved to a global pattern list 
named in the file by adding the .plist suffix to the leftmost name 
segment. 

5 7. If the reference has not been resolved by the prior steps, then the 

reference is in error. 

[0374] As mentioned earlier, the above rules dictate that the leftmost name segment 
resolves to either a local pattern list that is visible from the point of reference, or else to a 
global pattern list. 

10 [0375] The following example illustrates some of these ideas. 

GlobalPlist Gl 
{ 

PList 03; # OK. Refers to a pattern list later in this file. 

15 PList 04; # OK. Refers to a pattern list in file 

"04.plist" 



# OK. Refers to 01 in the file "my_plists.plist". 
PList my_plists.plist:01 ; 



20 



# OK. Refers to a pattern list in file "my_plists.plist". 

The 

# qualified name refers to a local pattern list named L2 
declared 

25 # in the scope of a local pattern list named LI declared 

in the 

# scope of a global pattern list named 01 . 
PList my_plists.plist:01.Ll.L2; 

30 LocalPList LI 

{ 

LocalPList L2 

{ 

} 

35 } 

PList LI; # OK. Refers to LI declared in the 
# enclosing scope of 01 



40 } 



OlobalPlist 02 

{ 
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LocalPList L2 

{ 

} 

5 GlobalPList G3 

{ 

LocalPList L3 

( 
} 

10 

PList LI; # Error. No LI declared in this or any enclosing 
# scope; 

# Error. The name L2 is not declared in this scope. Also 
15 # though L2 is declared in the enclosing scope, this scope 

# is global, and so no further enclosing scope is examined. 
# 

# Contrast with reference to name L2 in LocalPList L3 below. 
PList L2; 

20 

PList Gl .LI ; # OK. Refers to LI in Gl . 

# Error. G3 is not really nested inside Gl. Since G3 

# is global, it is really declared at an outermost level, 
25 # and so Gl .G3 is meaningless. 

PList G2.G3.L3; 

} 

LocalPList L3 
30 { 

# OK. Refers to G2.L2. The enclosing global scope is G2 

# and the name L2 is declared in G2. 
PList L2; 

} 

35 } 

[0376] All pattern list file names and pattern file names are required to be unique 

across the test plan using them. 

[0377] A pattern list reference can refer to a pattern list defined either before or after 
the reference in the same file. 
40 [0378] Recursive and mutually recursive pattern list definitions are not permitted. 

While there is nothing in the pattern list file syntax to prevent the user from creating such 
definitions, the parser will flag an error when it detects such conditions. Note that there is 
some cost associated with the detection of such conditions. The user will be able to switch 
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off the check if s/he can assume the responsibility of guaranteeing that the input space is 

free from mutually recursive definitions. 

GlobalPList Gl 
{ 

5 LocalPList L2 

{ 

LocalPList L3 

' { 

# Error. L2 runs L3 which runs L2. 
1 0 # This is a recursive reference to L2 

PList L2; 

PList 02; 



15 } 

} 



} 



GlobalPList G2 

{ 

20 # Error. G1.L2 runs L3 which runs G2 which runs 

G1.L2. 

# This is a mutually recursive reference to G1.L2. 
PList G1.L2; 

} 

25 [0379] The syntactic description of patterns and pattern lists allows for options to be 
specified on them. In general options are vendor specific. The syntax allows for any 

pattern or pattern list to have a number of options specified, each with a number of 
parameters. In we describe some supported options that will be recognized by most 
vendors. 

30 [0380] The dynamic (i.e., execution) semantics of pattern trees is described in after 
defining a pattern execution sequence. 

E2. Patterns 

[0381] Figure 6 illustrates a pattern compiler 602 and a pattern loader 604 according to 
an embodiment of the present invention. The user-defined contents of a pattern are 

35 available in a pattern source file 606, which is a plain text file. A pattern compiler will be 
responsible for compiling a source file into a module-specific format suitable for loading 
on the tester hardware; this latter file will be referred to as the pattern object file. The 
following are the general attributes: 

1 . A Pattern object is not creatable by the user; rather, the user always deals 

40 with pattern lists, which are collections of other pattern lists and/or patterns. 
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A pattern list object creates, owns and maintains the pattern objects 
contained within it, while making them accessible to the user if necessary. 

2. A pattern is uniquely named within a test plan, i.e., no two patterns within 
the test plan can have the same name. The name of a pattern is distinct 
from the name of the file containing it. The pattern file name is the one 
used in the pattern list file to refer to a pattern, while the actual name of the 
pattern is defined in the pattern file. 

[0382] In an embodiment of the invention, in general, a single DUT (device-under-test) 
might be connected to tester modules from different vendors. This has implications for the 
entire pattern compile-load-execute chain. The main ones are described in this section. 

E3. Pattern Compilation 

[0383] A pattern compiler 602 thus needs to target a specific site configuration (in 
terms of the vendor-specific digital modules used). For the rest of this discussion, the term 
"module" will be used to refer to a digital module, as an example. In order to allow the 
integration of modules 608 from different vendors into the system, the following 
procedures are preferred: 

1 . Each module vendor will be responsible for providing its own module- 



specific pattern compiler 610, in the form of a dynamically loadable library 
or separate executable. This compiler library/executable will provide, at the 
very least, a well-known compileQ fimction that takes as arguments 



a. 



an array of (one or more) pattern source file pathnames, 



b. 



the Pin Description file name, 



c. 



the Socket file name. 



d. 



an optional directory pathname specifying the destination of the 
compiled object. 



e. 



an optional array of string name/value pairs that allow the 
specification of any vendor-specific parameters (that can be ignored 
by other vendors). 



2. 



The pattern source file will accommodate two different types of sections: 
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a. 



a "common" section that will contain information accessible to (but 
not necessarily used by) all compilers, and 



b. 



one or more optional vendor-specific sections, each identified by 
unique vendor codes, for information usable by specific vendors' 
compilers. 



3. A vendor's compiler will not directly create a pattern object file. Instead, 
the tester will provide for a pattern object '^metafile" 612, managed by an 
Object File Manager (OFM) 614, which is part of the pattern compiler. 
The pattern compiler may be located on the computer acting as the system 
controller, or offline, e.g., on a network to which the system controller is 
connected. The "pattern object file'' referred to so far in abstract terms is 
actually this object metafile. The object metafile will be named the same as 
the pattern source file, with the source file extension replaced by the object 
file extension. The OFM will provide an application programming 
interface (APIs) to read and write this file. The object metafile will have 
provisions for storing 

a. common header information, 

b. module-specific header information, including information 
identifying the corresponding module and the location of pattern 
data for the module, 

c. module-specific pattern data, organized as required by the module 
vendor, and capable of being interpreted by the module vendor. 

[0384] The OFM APIs will allow a module vendor's compiler to write module-specific 
header information and data into the object metafile. Note that this layout of the object 
metafile allows the pattern data to be organized on a per-module basis, even in the case 
where two or more modules in the targeted site are identical. 
[0385] Note that additional vendor-supplied configuration information might be 
needed by pattern compilers to facilitate the generation of module-specific hardware 
loading information that can take advantage of efficient data commvmications such as 
direct memory access (DMA). 



E4. Pattern Load for a Module 
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[0386] Each module vendor will be responsible for providing its own pattern loading 
mechanism 615, following the general procedure. The pattern object metafile 612 of a 
module 608 stores module-specific data in different sections 616. The vendor 
implementation will use the OFM APIs for accessing the relevant module-specific sections 
5 from the pattern object metafile. The tester fi-amework will be responsible for calling each 
module's load method in turn to load module-specific data to a module from the 
appropriate section of the metafile. 

E5. Pattern Files 

[0387] It is possible to have each compiler vendor specify entirely different plain text 
1 0 formats for patterns, which, in fact, might indeed be necessary in most cases. However, in 
general, for a cycle-based testing environment, where coherent and identical semantics 
across modules are necessary for every vector, a shared, generalized syntax for the pattern 
file is not only desirable, but may be necessary. This shared syntax is what will be 
specified for the "common" section in the pattern source file. In fact, for the majority of 
1 5 cases, it is envisioned that the "common" section is the only section (besides header 

information) that will be required in the pattern file, and every vendor's compiler will work 
with only that section. This section presents rules for the pattern file that all compilers 
should be able to interpret. The pattern file will be organized as follows: 
flle_contents 

20 versionjnfo pattern_definitions 

versioninfo 

Version version-identifier '; ' 

patterndeflnitions 
25 pattern _defmition 

pattern_definitions pattern _definition 
pattern _definition 

■ mainjieader '{' main_section '} ' 
main header '{' main section vendor _sections '} ' 
30 subrjieader '{' subr_section '}' 

subrjieader '{' subrjsection vendor _sections '}' 



main header 



MainPattern identifier 



mainsection 

35 CommonSection '{' common_contents 

main_section_domains '} ' 
commoncontents 

timing_reference timing_map_reference 

timing_reference 
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Timing file-name ';' 
timingjnapreference 

TimingMap file-name '; ' 
main_section_domains : 
5 main_section_domains main_section_domain 

main_section_domain 
main_section_domam 

Domain domain_name '{' main section contents '} ' 

domainjtame 
1 0 identifier 

main_section_contents : 

main_section_contents main_section_content 
main_section_content 
main_section_content : 
1 5 labeljspec main _pattern_spec 

main _pattem_spec 

labeljspec 

label •:• 

label 

20 identifier 

main _pattern_spec 

main_operation capturejnask Jlag '{' 
vectors _and_wavefi)rms '}' 
main_operation : /* empty */ 
25 common_operation 

jalop 

jsrjjp 

jsrcop 

jsc_op 

30 exitjop 

commonoperation 

idxijop 

idxin_op 

jecop 

35 jechjjp 

Jffj>P 

jni_op 
Idinop 

40 nopjjp 

pause jop 
sndcop 
sndt_op 
stfiop 

45 sti_op 

stps_op 
waitop 

/* 

* Instructions specific to the MAIN Patterns 
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V 
jsrop 

JSR identifier 

jsrc_op 

5 ■ iSRC identifier 

jsc_op 

JSC identifier 

jalop 

JAL identifier 

10 exitjop 

EXIT 

/* 

* Instructions common to both MAIN and SUBR Patterns 
♦/ 



15 


idxi op 








IDXI 24-bit number 




idxin_op 








IDXIn index-register 




jecop 




20 




JEC identifier 




jechop 








JECH identifier 




jff_op 








JFF identifier 


25 


iffi op 

JJJ A 








JFFI identifier 




jnijop 








JNI identifier 




ldin_op 




30 




LDIN index-register 




nopop 








NOP 




pause_op 








PAUSE 


35 


sndc_op 








SNDC 8-bit number 




sndt_op 








SNDT S-6?Y number 




stfiop 




40 




STFI 24-f>/Y nwffjfter 




sti_op 








STI 24-bit number 




stpsjop 








STPS 


45 


wait_op 








WAIT 




capture jnask JJag : /* empty */ 






capturejnask Jlag CTV 






capturejnask Jlag MTV 
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capturejnask Jlag MATCH 

vectors and jwaveforms : /* empty */ 

vectors _and_waveforms vector 
5 vectors _and_waveforms waveform 

vector 

vector _declaration '{' vector _data '} ' 
vector declaration 

Vector 

10 V 



vector data 



vector_datum 
vector data vector datum 



vector _datum 

1 5 pin_name '= ' vector-value '; ' 



waveform 



pin_name '=' identifier ';' 
waveform _declaration '{' waveform_data '} ' 



20 waveform_declaration 

Waveform 
W 

waveform_data 

waveform _datum 

25 waveform_data waveform _datum 

waveform_datum 

waveform-table-pin-group-name identifier ';' 

pin_name 

identifier 

30 vendor sections 

vendor sections vendor _section {} 
vendor _section {} 

vendor jsection 

VendorSection '{' vendor section contents '}' 

35 subrjieader 

SubrPattern 

subrjsection 

CommonSection '{' common contents 
source selection jable subr_section_domains '} ' 
40 CommonSection '{' common _contents 

subrjsection domains '} ' 
subr_section_domains 

subr_section_domains subr_section_domain 

subrsectiondomain 
45 subr_section_domain 

Domain domain_name '{' subr_section_content.s '} ' 
source selection table : 

SourceSelectionTabic '{' source _selector_definitions 

r 
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source selector jieflnitions: 

source _selector definitions source _selector_deflrtition 
source selector jjtefinition 

5 source selector _defmition: 

SourceSelector source _selector_name '{' 
source jnappings '}' 
source _selector_name 

identifier 

10 source jnappings 

source mappings source mapping 
source jnapping 

source jnapping 

pinjiame '=' source ';' 

1 5 source 

MAIN 
INVERT_MAIN 
SUBR 

INVERT_SUBR 

20 subr_section_contents : 

subr_section_contents subr section content 
subr_section content 
subr_section_content 

label spec subr _pattern_spec 
25 subr _pattern_spec 

subr j}attern_spec 

subrjyperation capturejnask Jlag '{' 
vectors _and_waveforms '} ' 
subr operation : /* empty */ 
30 common_operation 

rtnop 
stss_op 

/* 

* Instructions specific to the SUBR Patterns 
35 V 

rtnjop 

RTN 

stssjop 

STSS identifier 

40 

[0388] The following are the descriptions of undefined non-terminals used above: 

1 . version-identifier : A sequence of one or more characters from the set [0-9.], 
where the first character must be a digit. 

2. identifier : A sequence of one or more characters from the set [a-zA-Z_0-9], 
45 where the first character must be from the set [a-zA-ZJ. 
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3. vendor-section-contents : Arbitrary text that is meaningful only to a 
vendor-specific compiler. 

4. flle-name :A valid Windows file name (must be enclosed in double quotes if 
any white-spaces are contained in the file name). Note that this should be a 
simple file name, i.e., it should not have a directory component. 

5. waveform-table-pin-group-name : A sequence of one or more characters 
fi-om the set [a-zA-Z_0-9], where the first character must be from the set [a- 
zA-ZJ. This variable is declared elsewhere and holds the name of the 
waveform-table that is common to a group of pins. 

6. 24-bit number : A valid decimal number up to a maximxim of 1 67772 1 5. 

7. 8-bit number :A valid decimal number up to a maximum of 256. 

8. index-register :A valid decimal number. In one embodiment of a module 
this can have a value [1-8]. 

9. vector : This is similar to the Vector statement in STIL. Note that this 
refers to signal names and signal groups names, making it necessary for the 
compiler to have access to the Pin Description file. 

1 0. waveform-time-reference : A sequence of one or more characters from the 
set [a-zA-Z_0-9], where the first character must be firom the set [a-zA-ZJ. 

[0389] Pattern files will support comments, which are meant to be ignored by a pattern 
file compiler. Comments will start with the character, and extend to the end of the line. 
[0390] The following points should be noted with reference to the constructs in the 

pattern file's header and "common" sections: 

1 . The pattern-name item specifies the name that will be associated with the 
Pattern object that the pattern file contains the data for. This gets carried 
over to the header in the corresponding pattern object metafile. 

2. The waveform-rtime-reference is the name for a particular waveform-and- 
timing definition that would be defined externally to the pattern file, in the 
Timing file. The specification of a waveform-time-reference in the pattern 
file would bind that particular name (for a waveform-and-timing) to all 
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subsequent vectors, until another waveform-time-reference were 
encountered. 

3. The operand for a subroutine call (e.g., JSR and JSRC) is a string that 
should either be a pattern-spec label previously encountered in the same 
5 pattern file, or a pattern-spec label in an externally defined subroutine 

pattern. This operand will ultimately be resolved for the purposes of 
loading/handling subroutines. The labels for subroutine call operands are 
required to be unique across the system. 

[0391] Note that while waveform-time-reference names could be anything that is 
1 0 syntactically correct, due to specific hardware impUcations the waveform-time-reference 
names may need to be restricted to a previously known, well-defined set (which, for added 
readability, can be optionally mapped by the user to user-chosen names, the mapping 
presented in an optional file). 

[0392] Also note that the pattern and waveform-time-reference source files should 
1 5 provide initial configuration data for all DUT channels which have connections to physical 
tester channels. If subsequent data is omitted for any DUT channel, the pattern compiler 
will "pad" the pattern data to hold output from the initial level. 

Pattern File Example 

[0393] A simple example of a MAIN Pattern source file will help illustrate the usage. 

20 # 

# Filename : good 1. pat 
# 

Version 1.0; 

# 

25 # Main Pattern definition: 

# 

MainPattem goodl 

{ 

CommonSection 
30 { 

MacroDef 
MacroDef 
MacroDef 
MacroDef 

35 

# 

# Timing Specifications 
# 



defaultDataVal (XXXXXXXX) 
noplnstr (NOP) 
label 1 (Label 1 : ) 

jnilnst (JNI) 
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Timing "productionTiming.tim"; 

TimingMap "productionTimingOpenSTARMap.tmap"; 

# 

5 # Default Domain Cycles 

# 

Domain default 
{ 

# 

10 #label: instruction {Vector/Waveform Data} 

# . 

NOP { V { DATA = SdefaultDataVal; CLK = 1 ;} W 

{ DATA = wfsl ; CLK = wfsl ; } } 

JAL myAPG { V { DATA = 00000000; } } 
15 JSC mySCAN { V { DATA = 10101010; } } 

JSRC mySubroutine { V { DATA = 01010101;}} 
JSR myAPG { V { DATA = 001 1001 1; } } 
STI 100 { } 
labZero: NOP { V { DATA = 0000001 1; } } 

20 JNI labZero { V { DATA = 11 111 100; } } 

IDXI • 3000 { V { DATA = 10101010; } } 
IDXIn 3 {V {DATA = 01010101; } } 

Slabell NOP { V { DATA = SdefaultDataVal; } } 

IDXI 2000 { V { DATA = 10101010; } } 
25 NOP { } 

EXIT { V { DATA = LLHHLLHH; } } 

} 

} 

} 

30 [0394] Another example illustrating a SUBROUTINE pattern source file is illustrated 
below. 

# 

# Subroutine Pattern mySubrPatl definition: 

# 1 

35 SubrPattem mySubrPatl 

{ 

CommonSection 
{ 

40 # : 

# Timing Specifications 

# 

Timing "productionTiming.tim"; 

TimingMap "productionTimingOpenSTARMap.tmap"; 



45 



# 

# Source Selection Specifications 
# 
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SourceSelectionTable 

{ 

SourceSelector SrcSelDef 
{ 

5 DATA=SUBR; CLK=SUBR; DATA=SUBR; 

} 

SourceSelector SrcSelOne 
{ 

DATA=MAIN; CLK=MAIN; 

10 } 

} 

# — 

# Default Domain Cycles 

15 # 

Domain default 

{ 

# 

#label : instruction { Vector and Waveform Data setups } 
20 # 

STI 100 { Vector { DATA = 00000000; } } 
IDXI 3000 { Vector { DATA = 0000 1111;}} 
IDXIn 3 { Vector { DATA = 001 1001 1 ; } } 
Slabell NOP { Vector { DATA = LLHHLLHH; } } 

25 NOP { Vector { DATA = LLXXXXXX; } } 

NOP { Vector { DATA = LLHHXXXX; } } 

JNI Label 1 { Vector { DATA = LLHHLLHH; } } 
STSS SrcSelOne { Vector { DATA = LHLHLHLH; } } 
RTN { Vector { DATA = LLXXXXXX; } } 

30 } 

} 

} 

[0395] Simimary information from the main header and common section in the pattern 
source file is stored in the main header in the object metafile. The summary consists of 

35 information that is typically required for quick extraction to aid pre-load resolution of 
addresses, etc., or to aid in datalogging. Since the semantics of the common section are 
exactly the same for all compilers, every compiler will be capable of providing the same 
summary information, and the first compiler vvriting the metafile will store this information. 
The following is the information that will be stored: 

40 1 . The pattern source file name. 

2. The type of the pattern as declared in the source file. 

3. The version information from the source file. 
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4. A list of all the waveform-and-timing names used in the pattern source file's 
common section. 

5. A map of all subroutine references to (relative) vector addresses in the 
pattern source file's common section. 

5 6. A map of all label references to (relative) vector addresses in the pattern 

source file's common section. 

7. General bookkeeping information: vector count, instruction count, etc. 

[0396] The open architecture test system requires both pattern and pattern list files to 
have explicit, and different, extensions. For pattern files, this applies to both plain text 
10 source and compiled object files. This is viewed as a convenience to the user to quickly 
identify the file type visually in a directory listing, etc., as well as allow associations to be 
made on the basis of extensions. The pattern list file parser will expect filenames with 
these extensions: 

Plain text pattern source file: .pat 

1 5 Compiled pattern object metafile: .pobj 

Pattern list file: .plst 
[0397] The user can override these default values, e.g., through tester environment 
variables or setup options. 

[0398] The tester will require the definition of the following "environment" variables 
20 for file search paths in at least one of the environment conftguration flies described in: 

Tester_PATLIST_PATH: For pattern list files. 

Tester_PATSRC_PATH: For pattern source files (optional). 

Tester_PATOBJ_PATH; For pattern object metafiles. 
[0399] Note that if the optional environment/setup variable Tester_PATSRC_PATH is 
25 not defined, it will be assumed to be the same as Tester_PATOBJ_PATH. In general, it 
would be more efficient to not define Tester_PATSRC_PATH rather than define it with 
the same value as Tester_PATOBJ_PATH. 



30 



E6. Software Representation 

[0400] A Pattern object is not created by the user; rather, the user always deals with 
Pattern List objects, which are collections of other pattern lists and/or patterns. A Pattern 
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List object creates, owns and maintains the pattern objects contained within it, while 
making them accessible to the user. A pattern list object in the user's test program is 
associated with a pattern list file on disk, which contains the actual definition of the pattern 
list. The definition of a pattern list provides an explicit name for the pattern list, and 
identifies an ordered list of patterns and/or other pattern lists through file name 
associations. This section describes the software representation of pattern lists and patterns, 
as a prelude to understanding how they are manipulated in the tester framework. 

Pattern List Associations 

[0401] A single test site in the test system (and, by extension, the test plans in it) can 
be associated with multiple top-level pattern lists. However, there is only a single 
execution context for test plans at any given time. Since a top-level pattern list defines an 
execution sequence for the patterns referred to (hierarchically) by it, the active execution 
context is the one corresponding to the currently selected top-level pattern list. Note that 
this does not imply that only the patterns contained in a single pattern list can be loaded on 
the hardware at one time; rather, the set of patterns that are required to be loaded on the 
hardware to make an execution sequence viable must always be a subset of all the 
currently loaded patterns. 

Pattern Trees 

[0402] Intuitively, it is felt that a way to represent a top-level pattern list is by some 
sort of a tree data structure. Figure 7 illustrates an embodiment of an ordered pattern tree 
of the invention, assuming that the pattern Xi^iA is the top-level pattern list 

Pattern Tree Information Content 

[0403] The following information will be stored at every node of the pattern tree: 

1 . The name of the entity (pattern-list or pattern) associated with that oode. 

2. The type of the definition source. For a leaf (pattern node), this will always 
be a pattern file; for an intermediate (pattern list) node, this could be either 
"top-level file" (for top-level pattern list definitions) or "embedded in file" 
(for nested pattern-list definitions). 

3. The last modification timestamp of the file on disk the node is associated 
with. 
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[0404] The following additional information will be stored only in intermediate 
(pattern list) nodes: 

1 . Execution options (if any) set on the pattern-list object represented by that 
node — i.e., its object options. 

5 2. The execution options (if any), set on each child reference inside the pattern 

list definition represented by that node — i.e., the reference options, for 
each of its children. 

[0405] Thus, the collection of nodes encountered on the unique path from the root to 
an intermediate node, and the sequence in which they are encountered, contain all the 
10 information necessary to determine the combined, effective, execution options represented 
by that node . The execution options of a pattern are determined by the effective execution 
options of its immediate parent, combined with the reference options its immediate parent 
might have for it. 

[0406] It should be noted here that while the pattern list parser is in the process of 
1 5 creating the pattern tree, certain execution options might require initial storage of values 
simply as strings, since the context of their use might not be resolved until later. An 
example of such an option is a "mask" option, which specifies pin mask information: 
pattern lists are not associated with Socket information, and hence, pin mask options (pin 
and group names) are stored as strings, to be resolved prior to loading. 
20 [0407] The following additional information will be stored only in leaf (pattern) nodes: 
1 . All (possibly transitive) references to subroutines called by that pattern, 
both external and internal, organized as an execution tree. 

[0408] Of course, all pattern nodes will additionally have access to — and might 
choose to cache — all the pattern file summary information available in the object metafile 
25 common header. 

Handling Pattern List Modiflcations 

[0409] Changes made to the contents of a pattern list conceptually affect all references 
to that pattern list. The following rules, which apply as appropriate to pattern objects as 
well as pattern list objects, will be used to manage such changes: 
30 1 . A change made to the contents of a pattern list file on disk will be 

propagated through the test system only on a loadQ command being 
executed on that pattern list (or on any other pattern list that references that 
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one). In other words, the pattern list hierarchy in software will always 
reflect the one currently loaded on the hardware. 

2. The user will be able to set a mode that will defeat the checks made during 
load time to synchronize pattern lists with their disk file sources; this will 
5 allow quicker/safer operation in production mode. 

Pattern Tree Navigation 

[0410] The top-level pattern lists associated with a test site (and, by extension, with a 
test plan for that site) have public (global) scope. The system provides APIs to navigate 
the pattern tree representing a top-level pattern list so that users can get access to 
1 0 individual nodes and sub-trees. 

E7. Pattern List Dynamics 

[0411] Earlier the static rules of Pattern Lists were described. A description of the 
dynamic (execution) rules of pattern lists is now presented. 

[0412] The pattern tree is essential for general pattern management. For example, the 
1 5 starting point for a pattern load sequence is a call to the loadQ method on the pattern tree 
currently associated with the site or test plan. However, a pattern tree does not operate in 
isolation. A fully initialized pattern tree will be used to create the following two 
framework objects: 

[0413] 1 . A top-level pattern Hst defines a Pattern Execution Sequence for the 
20 patterns. It describes how such an execution sequence can be derived from the pattern tree 
corresponding to that top-level pattern list. For example, the pattern execution sequence 
corresponding to the pattern tree A shown in Figure 7 is {q, s, t, q, r, q, u, u, v}. The 
Pattern Execution Sequence is conteptually an ordered list reflecting the execution 
sequence described through the pattern tree. The framework establishes and maintains any 
25 necessary navigation links between pattern tree nodes and corresponding entries in the 
Pattern Execution Sequence. 

[0414] 2. The Pattern Set, which is simply a list of all the unique patterns (including 
subroutines) in the pattern tree. This is thus the list that will be used to determine the 
individual patterns that should be loaded on the hardware. The framework establishes and 
30 maintains any necessary navigation links between pattern tree nodes and corresponding 
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entries in the Pattern Set. The Pattern Set for the pattern tree of Figure 7 is (q, s, t, r, u, v) 
(it is assumed that none of the patterns in pattern list A contain any subroutine calls): 
[0415] Note that both the Pattern Execution Sequence and the Pattern Set can always 
be derived from the pattern tree; however, it would often make sense to cache them, after 
5 initial construction, for as long was viable. 

Pattern List Execution Options 

[0416] As shown above, each pattern list declaration (preceding its definition) or 
pattern list/pattern reference entry can be followed by a number of execution options. 
Pattern list execution options modify the runtime execution of pattern lists. To allow 
10 future extensions, the names (and optional values) for these options will be treated simply 
as strings by the pattern list file parser of the pattern compiler, to be interpreted by a 
particular version as appropriate. Tester prescribes a set of options and their 
interpretations, described below. However, vendors can extend the set of options. In order 
to allow a parse-time validation of option syntax, the pattern list file parser could read an 
15 information file for a particular version. Such an information file could also be used to 
specify whether a particular version at all supports the specification of execution options. 
[0417] For versions that support a set of execution options, the following general rules 
will govern their use. In order to imderstand these rules, it is useful to visualize the 
hierarchical collection of pattern lists/patterns as an ordered tree. 
20 1 . Intrinsic options set on pattern list definitions (i.e., in the "local-pattern- 

list-declaration, global-pattern-list-declaration" productions in the file are, 
in effect, direct option settings on the corresponding Pattern List object in 
the user's test program. They thus apply to all references to that pattern list 
object, and are referred to as object options. 

25 2. Referential options set on references to pattern lists/patterns (i.e., in.the 

"pattern-entry''' and "pattern-list-entry" productions in the file limits the 
scope of the options to a specific path in the hierarchy — the path 
(established by the declaration order of pattern lists/patterns) that leads from 
the root of the tree to the reference under consideration. These are thus 

30 options on specific object references (and not on the objects themselves), 

and are referred to as reference options. 
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3. The effective option settings for any list/pattern in the collection hierarchy 
(established by the declaration order of pattern Hsts/pattems) are a 
combination of the object and reference options encountered along the path 
from the root of the tree to that list/pattern. The specific combination 
5 mechanism (e.g., set union, set intersection, or any other conflict resolution 

algorithm) is a property of the option itself 

[0418] Note that a consequence of the above rules — and the fact that there is no 
facility to set execution options on a pattern definition in a pattern file — is that there is no 
direct rule to set options which apply to all references to a pattern. The mechanism for 
1 0 achieving this is to use a single-pattern pattern list. 

[041 9] The tester specifies a certain set of pattern list execution options that modify its 
burst behavior, and that modify its execution sequence. 

[0420] When an execution sequence for a pattern list is submitted to the hardware, the 
hardware produces a burst. A Burst is the execution of a sequence of patterns directly by 
1 5 the hardware, without any involvement from the software. A Burst Discontinuity is a 
position in an execution sequence where a prior burst is terminated, and a new burst is 
started. 

[0421] One of the objectives of the pattern management software is to provide the 
hardware with the execution sequences that it needs to produce a burst on. By default, a 

20 pattern tree yields an execution sequence, which if submitted to the hardware will result in 
a single burst. This behavior can however be modified by the use of options on the pattern 
list. Thus, the use of options result can result in burst discontinuities. 
[0422] Furthermore, users will sometimes require a prologue or epilogue pattern to be 
run before or after every pattern or every burst. This modifies the execution sequence to 

25 be submitted to the hardware. 

[0423] During the creation or modification of the Pattern Execution Sequence object, 
the framework has all the information necessary to determine, and report if required, 
breaks in pattern bursts resulting from the combination of execution options specified and 
the particular execution sequence embodied by the pattern tree. While doing this, it might 

30 need to investigate the hardware capabilities of the modules in the system. For example, 
one hardware implementation allows four stored configurations for pin masks, of which 
two (0 and 3) are used for default masked (to support Mask This Vector, MTV) and 
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unmasked operation. The user is thus allowed two different global pin-mask 
configurations without breaking burst mode.' 

[0424] Note that if a module vendor does not support pattern list implementations in 
hardware, the vendor's processing of the Pattern Execution Sequence would result in 
individual execution of all patterns in the execution sequence. In both Site-Compatible and 
Site-Heterogeneous systems, the burst capability of sites would be limited by the "lowest 
common denominator". The tester provides for a certain default set of options and their 
parameters is described below. Each option is specified by stating: 

Whether it is Intrinsic (i.e. associated with a definition with the Global or Local 
keyword) or Referential (i.e. associated with a reference with the Pat or PList 
keyword). Intrinsic options apply at the point of definition and at every reference, 
but referential options apply only at the reference they are associated with. 

Furthermore, an option is said to be Inherited by Children if the option is assumed to apply 
recursively to all statically (syntactically) or dynamically (semantically by being 
referenced) nested patterns or pattern lists. 

[0425] Below is the list of options. Every compliant vendor will interpret these options 

as specified. 

1 . Mask <pin / pin group> 

Intrinsic when applied to GlobalPList, LocalPList 
Referential when applied to PList, Pat. 
Inherited by children. 

This pattern list will always have the compare circuits of the pins referred to 
by the indicated pin or pin group disabled. Sometimes, hardware 
limitations may result in burst discontinuities. 

2. BurstOff 

Intrinsic when applied to GlobalPList, LocalPList 
Referential when applied to PList, Pat. 
Not inherited by children. 

This pattern list will always execute in the non-burst mode. This option is 
not inherited by children, but the BurstOffDeep option (below) is inherited 
by children. 
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3. BurstOffDeep 

Intrinsic when applied to GlobaiPList, LocalPList 
Referential when applied to PList, Pat. 
Inherited by children. 

5 This pattern list will always execute in the non-burst mode. This option is 

inherited by children, but the BurstOff option (above) is not inherited by 
children. Note that, the BurstOffDeep option caruiot be turned off by a child. 

4. PreBurst <pattem> 

Intrinsic when applied to GlobalPList, LocalPList 
1 0 Inherited only by child nodes having no burst options specified. 

The indicated pattern is to be prefixed to all bursts within this pattern list. 
The PreBurst pattern occurs just before every burst that is started due to this 
pattern list node. The option is not applied when already within a burst 
which has a PreBurst option that is the same pattern. 

15 5. PostBurst <pattem> 

Intrinsic when applied to GlobalPList, LocalPList 

Inherited only by child nodes having no burst options specified. 

The indicated pattern is to be suffixed to all bursts within this pattern list. 

The PostBurst pattern occurs just after every burst that is started due to this 
20 pattern list node. The option is not applied when already within a burst 

which has a PostBurst option that is the same pattern. 

6. PrePattem <pattem> 

Intrinsic when applied to GlobalPList, LocalPList 
Not inherited by children. 
25 The indicated pattern is to prefixed to all patterns within this pattern- list. 

7. PostPattem <pattem> 

Intrinsic when applied to GlobalPList, LocalPList 
Not inherited by children. 

The indicated pattern is. to be suffixed to all patterns within this pattern list. 

30 8. Alpg <alpg object name> 

Intrinsic when applied to GlobalPList, LocalPList 
Not inherited by children. 
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The named ALPG object stores relevant information such as slow speed 
APG register settings, read latency, immediate data registers, address 
scramble, data inversion, data generators, etc. 

9. StartPattem <pattem> 

Intrinsic when applied to GlobalPList, LocalPList 
Not inherited by children. 

The pattern list will start executing at the first occurrence of the StartPattern 
in its execution sequence. 

10. StopPattem<pattem> 

Intrinsic when applied to GlobalPList, LocalPList 
Not inherited by children. 

The pattern list will stop executing at the first occurrence of the StopPattem 
in its execution sequence. 

1 1 . StartAddr <vector offset or label> 

Intrinsic when applied to GlobalPList, LocalPList 

Not inherited by children. 

This must be accompanied by a StartPattem option. The pattern list will 
start executing at the StartAddr in the first occurrence of the StartPattem in 
its execution sequence. 

12. StopAddr <vector offset or label> 

Intrinsic when applied to GlobalPList, LocalPList 
Not inherited by children. 

This must be accompanied by a StopPattem option. The pattern list will 
stop executing at the StopAddr in the first occurrence of the StopPattem in 
its execution sequence. 

13. EnableCompare_StartPattern <pattem> 
Intrinsic when applied to GlobalPList, LocalPList 
Not inherited by children. 

Pattern comparison will commence at the first occurrence of the indicated 
pattern. 
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1 4 . EnableCompare StartAddr, EnableCompare StartCycle 
Intrinsic when applied to GlobalPList, LocalPList 

Not inherited by children. 

This must be accompanied with EnabelCompare_StartPattern. Indicates the 
address or cycle within the pattern where pattern comparison is to start. 

1 5 . EnableCompare_StopPattem <pattem> 
Intrinsic when applied to GlobalPList, LocalPList 
Not inherited by children. 

Pattern comparison will complete at the first occurrence of the indicated 
pattern. 

16. EnableCompare StopAddr, EnableCompare StopCycle 
Intrinsic when applied to GlobalPList, LocalPList 

Not inherited by children. 

This must be accompanied with EnableCompare_StopPattem. Indicates the 
address or cycle within the pattern where pattern comparison is to complete. 

17. Skip. 

Referential when applied to PList, Pat. 
Not inherited by children. 

Causes a pattern or the entire subsequence dominated by a pattern list to be 
skipped. This will also cause skipping of all options at the root of this 
pattern list sub-tree. It is as if this pattern sub-tree were not there for 
execution purposes. 

Pattern List Burst Control 

[0426] As described earlier, when an execution sequence for a pattern list is submitted 
to the hardware, the hardware produces a burst of a sequence of patterns, without any 
involvement from the software. A Burst Discontinuity is a position in an execution 
sequence where a prior burst is terminated, and a new burst is started. The PreBurst , 
PostBurst, BurstOff and BurstOffDeep options control where the burst discontinuities 
occur, as described in the option list above. PreBurst and PostBurst options determine 
burst discontinuities subject to certain additional rules described below: 
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1 . When a parent list has PreBurst and PostBurst options, and the nested list 
has the same conesponding options, there is no burst discontinuity, and the 
PreBurst and PostBurst options of the nested list do not apply. There is 
only a single burst applying the PreBurst and the PostBurst of the parent list. 

2. Notice that when the nested list has no burst options, it is equivalent to 
having the same PreBurst and PostBurst options as the parent list by the 
description of these options. Consequently, nested lists with no burst 
options do not result in a burst discontinuity. 

3. If rule 1 above does not apply and there is a contribution to the pattern 
execution sequence from the start of the parent list to the start of the nested 
list, then there is a burst discontinuity at the start of the nested list. In this 
case the PreBurst and PostBurst of the parent list apply to this contribution 
to the pattern execution sequence from the parent list. The PreBurst and the 
PostBurst of the nested list apply to the nested list. 

4. If rule 1 above does not apply, and there is a contribution to the pattern 
execution sequence from the end of the nested list to the end of the parent 
list, then there is a burst discontinuity at the end of the nested list. In this 
case the PreBurst and PostBurst of the parent list apply to this contribution 
to the pattern execution sequence from the parent list. The PreBurst and the 
PostBurst of the nested list apply to the nested list. 

5. If rule 1 does not apply, and there is no contribution to the pattern execution 
sequence from the parent list other than from the nested list, then the 
PreBurst and the PostBurst of the parent list do not apply. There is only a 
single burst applying the PreBurst and PostBurst of the nested list. 

[0427] Below are a few examples illustrating the effect of options on the execution 
sequence. To simplify, it is assumed that all the pattern lists are specified in a single file. 
[0428] Example 1: Use of BurstOff 

[0429] This example illustrates BurstOff and PreBurst. Of particular emphasis is that 

BurstOff causes patterns to run singly in bursts that are one pattern long. Hence the 

PreBurst option still applies. The input pattern lists are as below: 

Global A [BurstOff] [PreBurst pat_z] 
{ 
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Pat q; 
PList B; 
Pat r; 
Pat s; 

5 

Global C 
{ 

Pat t; 
PList D; 

10 }; 



15 



30 



PList D; 
PList E; 



}; 



Global B 
{ 

Pat a; 

20 Pat b; 

}; 



Global D [BurstOff] 
25 { 



Pate; 
Patd; 



Global E 
{ 

Pate; 

}; 

35 The tree rooted at A may be represented in Figure 8. 

[0430] The execution sequence for this pattern is below. The | character indicates a 
burst break. This pattern list executes in 10 bursts, the first one having patterns z and q, 
and the last one with pattern e: 

zq|ab|zr|zs|t|c|d|c|d|e 
40 [0431] Note the following about this execution sequence: 

1 . Since the BurstOff option on A is not inherited by B, the patterns a and b in 
B operate as a burst. 
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2. Since the PreBurst option on A is not inherited by B, the a and b in the burst 
by B is not prefixed by z. 

3. The prefix by z only happens for the patterns that are executed due to being 
direct children of a, namely patterns q, r and s. These patterns are executed 

5 singly as if in a burst that is only one pattern long due to A having the 

BurstOff option. The BurstOff requires patterns to be run individually in 
one-pattern long bursts. Hence, the PreBurst and PostBurst options still 
apply. 

4. Pattern list D has an intrinsic burst off option that causes its children c and d 
10 to execute singly. They do not inherit the PreBurst z from A. 

[0432] Example 2: Use of BurstOfiDeep 

[0433] This example illustrates the BurstOfifDeep option. BurstOffDeep during pattern 
list definition affects nested definitions and referenced lists. However, PreBurst and 
PostBurst options are not inherited by nested and referenced lists. The example uses the 
1 5 same patterns A, B, C, D, E as in example 1 , but the options are different: 

5. Options on definition of A: [BurstOfifDeep], [PreBurst z], [PostBurst y] 

6. No other options on any other node. 

[0434] The execution sequence is as below. As earlier, the | character indicates a burst 
break. 

20 zqy|a|b|zry|zsy|t|c|d|c|d|e 
Note the following about this execution sequence: 

1 . PreBurst and PostBurst are not inherited by B, C, D, E. 

2. BurstOffDeep is inherited by B, C, D, and E. 

[0435] Example 3: PreBurst and PostBurst Inhibition 

25 [0436] Suppose now the pattern list tree of Example 1 is considered, where the options 
are: 

1 . Options on definition of A: [PreBurst x] [PostBurst y] 

2. Options on definition of C: [PreBurst x] [PostBurst z] 

3. No other options on any other node. 
30 [0437] The execution sequence would be: 
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xqabrstcdcdey 

[0438] The reasons why the "t c d" subsequence is not "x t c d z" are as follows: 

1 . The first x is inhibited since it is equal to the pre-burst option x that is 
associated with the current burst in effect. 

5 2. The last z is inhibited since the PostBurst z is not inherited to D, and there is 

no pattern that is generated from C to which the z can be appended. 

[0439] Example 4: Use of Skip 

[0440] This example illustrates the effect of the Skip option on nested definitions and 
referenced lists. The example uses the same patterns A, B, C, D, E as in example 1 , but the 
10 options are different: 

1 . Options on definition of A: [Skip], [PreBurst z], [PostBurst y] 

2. Options on reference to r: [Skip] 

3. Options on definition of C: [Skip] 

[0441] The execution sequence is a single burst with no breaks as below: 
15 zqabscdey 

[0442] Note the following about this execution sequence: 

1 . The nodes for r and C are skipped. 

2. There are no burst breaks at all. 

[0443] Example 5: Use of Mask 
20 [0444] This example illustrates the effect of the Mask option and its effects on pattern 
and pattern list definitions and references. The example uses the same patterns A, B, C, D, 
E as in example 1, but the options are different: 

1 . Options on definition of A: [mask pinl j)in2], [PreBurst z] 

2. Options on reference of B: [mask pin3] 
25 3. Options on definition of B: [mask pin4] 

4. Options on reference of e: [mask pin5] 

5. No other options on any nodes. 

[0445] The name "pinl _pin2" specifies a group which masks Pinl and Pin2. The 
names "pin3", "pin4" and "pin5" specify masking Pin3, Pin4and Pin5 respectively. The 
30 execution sequence is provided below, with | indicating the burst break. The numerals 
below each pattern indicate the pins that are masked during that pattern execution. 
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zqabzrzstcdcd|e 
1 1 1 1 1 1 1 II 1 1 1 1 1 
2222222222222 2 
3 3 5 
5 4 4 

[0446] Note the following about this execution sequence: 

1 . The vendor's hardware can only accommodate 2 mask blocks without a 

burst break. Until e is executed the two mask blocks are pins {1,2} and 

pins { 1 , 2, 3, 4}. When pattern e arrives with a different mask block of pins 

10 { 1 , 2, 5 } , the hardvi^are requires a burst break. 

[0447] Example 6: Use of Inherited Options and References 

[0448] This example illustrates that an inherited option at a definition does not apply 

when the definition is referenced. Consider the following example: 

Global A 
15 { 

Global B [BurstOffDeep] 
{ 

Global C 

{ 



20 



25 



}; 
};' 



PList C; 

}; 



Global D 
30 { 

PList C; 

}; 

[0449] The BurstOffDeep option is inherited by C at its point of definition. However, 
it is not an intrinsic option, and so it is not applied to C at both its point of references. 
35 [0450] Example?: PreBurst and PostBurst with Nested Lists 
[0451] Consider the following example: 

GlobalPList A [PreBurst x] [PostBurst y] 

{ 

Pat pi; 

40 

LocalPList B [PreBurst x] [PostBurst y] 
{ 
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Pat p2; 



10 



15 



20 



25 



} 



LocalPList C 
Pat p3; 

LocalPList D [PreBurst x] [PostBurst z] 
Pat p4; 

LocalPList E [PreBurst w] [PostBurst y] 
Patp5; 

Pat p6; 



[0452] The execution sequence is: 

X pi p2 p3 y I X p4 z I w p5 y I X p6 y 

1 . Pattern p2 is in the same burst as pi because the PreBurst and PostBurst 

options of the nested list are specified the same as the parent. Pattern p3 is 
also in the same burst because these options are inherited the same as the 
parent. These options have at least one different member in the remaining 
nested lists, giving rise to burst discontinuities 



Timing 

[0453] The user interacts with the system primarily by defining the test setups using 
30 pattern files. The Timing File is used to describe the Timing of these patterns. This file 

requires other system files (e.g. Pin, SpecSelector) for underlying defmitions to be .resolved. 
Further the Spec-Selectors and Global defmitions used to resolve various variables used in 
the Timing definition are encapsulated in a composite TestConditionGroup object. Higher- 
level files, such as the Test Plan file, in turn use this TestConditionGroup instance. 
35 [0454] The Test Plan File contains references to the TestConditionGroup object. The 
Pattern Source File makes references to the WaveformSelector components within a 
TimingMap object. The Timing objects itself references the Pin objects. Optionally the 
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Timing object might also reference a variable modulated by a SpecSelector object. These 
relationships are illustrated in Figure 9. 

[0455] The Pattern object within the Pattern- List specifies the name of the 
WaveformSelector object to use for a set of pattern characters. Also note that the Timing 
Map file is specified in the pattern. Patterns need not be compiled if this map is not 
changed. 

Version 1.0; 
MainPattem 
{ 

CommonSection 

{ 

Timing = myGalxy.tim; 
TimingMap = myGalxyMap.tmap; 

Domain default 
{ 

NOP V {SIG=1; CLK=1 ; DATA=L; } W {§IG=wfsl; 

FASTCLK=wfsl; } 
NOP W {SIG=wfs2;} 
NOP V {SIG=L;} 
NOP V {SIG=0;} 



} 



} 



Here we define the 
WaveformSelector 
component of the TimingMap 
to use for the pattern 
characters. 



[0456] The TestConditionGroup File objects import the Timing object to use and the 
TimingMap object to use. Each Test uses a TimingCondition instance derived from the 
TestConditionGroup object for that instance. Thus multiple Timing objects, which support 
the same set of waveform tables, can be stored in the tester framework and can be swapped 
as required. Similarly multiple Test Plan Files can share a common TestConditionGroup 
object. 

[0457] An example of a Test Plan description file illustrates the usage of the Timing 
object below. 

Import patlist 1 .plist; 
Import timl.tim; 
Import tim2.tim; 
Import tmapl .tmap; 
TestConditionGroup timl_prod 
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35 



40 



45 



SpecSet = prodTmgSpec(min, max, typ) 
{ 

period = 10ns, 15ns, 12ns; 

} 

Timings 
{ 



Timinfi Ftiml; 



} 



TimingMap = tmapl ; 



Two Tests within a Test 
Plan using different 
timing objects defined 
earlier. 



} 

TestConditionGroup tim2_pro/ 
{ 

SpecSet = prodTmgSpe^(min, max, typ) 
{ 

period = 10ns, ISfls, 12ns; 

} 

Timings 
{ 



Timing = tim2; 



} 



TimingMap = tmapl; 



TestCondition timl_prod_typ 

TestConditionGroup = timl_prod; 
Selector = typ; 

TestCondition tim2_prod_max 

TestConditionGroup = tim2_prod; 
Selector = max; 



Test FunctionalTest MyFunctionalTestSlow 

PListParam =patlistl; 
TestConditionParam = timl_prod_typ; 



Test FunctionalTest MyFunctionalTestFast 

PListParam =patListl; 
TestConditionParam = tim2_prod_max; 



wo 2005/114240 



PCT/JP2005/009815 



10 



15 



20 



25 



162 

[0458] The Timing object defines various waveforms on a per pin basis. The pins used 
in the Timing file and the Timing Map file need to be defined appropriately in the Pin 
definition file. 

[0459] The Timing object can use SpecificationSet objects to define values within the 
waveform objects. Though the Timing object can include hard-coded values for various 
attributes it is usually the case that users have various attributes be assigned values using 
variables. These variables in turn can depend on SpecificationSet objects. An example of 
this usage is illustrated below. 

Version 1 .0; 



Timing basic_functional 
{ 

Pin SIG 
{ 

WaveformTable wfs. 



This variable, which defines the 
edge placement, is defined 
elsewhere and is dependent on a 
SpecificationSet. 




{ 1 i U@.t lei : D@t_te D; Z@45ns;} } 



} 



}; 
}; 

Pin CLK 
{ 

WaveformTable wfsl 
{ 

{ 0 { U@20ns; D@40ns; }}; 

}; 



[0460] The SpecSelector is defined as illustrated below. 



30 



35 



40 



SpecificationSet prodTmgSpec( min, max, typ) 
{ 

t_le = 10ns, 14ns, 12ns; 
t_te = 30ns, 34ns, 32ns; 

} 

[0461] The changing of the timing used by changing the spec is illustrated in the 

example below. ^, . . . 

This timing 

uses the typical 

specification in 

the 

SpecSelector. 



TestCondition prodTmp_typ 
{ 

TestConditionGroup = prodTmgSpec; 
SpecSelector ftyp; 

} 
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TestConditionGroup prodTrap_max 
{ 

TestConditionGroup = prodTmgSpec; 



SpecSelector f max; \^ 



This timing uses 
the max 

specification in the 
SpecSelector. 



F2. Mapping to the Timing Components of a tester 

[0462] Two components of a tester module are directly involved with the generation of 

wave shapes and their associated timings. The two modules are the Pattern Generator 
(PG) and the Frame Processor (FP). A simplified block diagram illustrating the wave 
shape formatting and the timing generation by the Frame Processor within the open 
architecture test system architecture is illustrated in Figure 10. A brief description of the 
generation of waveforms is given below. 

[0463] The Pattern Generator 1002 generates a timing set which is common for all the 
pins in the module. This timing set is called the Global Timing Set (GTS). There are three 
modes in which the Pattern Generator can be set up. These three modes affect the number 
of bits that can be used to describe the GTS. In addition these settings also impact the 
number of bits used to select a bank and whether the Capture This Vector (CTV) and Mask 
This Vector (MTV) bits are set or not. To instruct the tester to capture the results of this 
vector, the user uses the CTV flag in the Pattern file. Similarly the user uses the MTV flag 
in the pattern to instruct the tester to mask the results of the current vector. This is 
illustrated in Table 1 below. The Pattern Generator 1002 is also responsible for the 
generation of Waveform Characters (WFC). WFCs are generated on a per pin basis. The 
tester module uses a fixed number of bits to describe the WFCs. 



GTS bits 


GTS in a 
Bank 


GTS Bank 


CTV 


MTV 


8bits 


256 


4 


NO 


NO 


7bits 


128 


8 


YES 


NO 


6bits 


64 


16 


YES 


YES 


[0464] Table 1 



[0465] The tester module provides a Frame processor 1 004 per pin. Each Frame 
Processor contains a Timing Set Scrambler (TSS) 1006, which has a total depth of up to 
1024 in this example. The TSS 1006 can be partitioned into a number of banks 1008 
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depending on the mode of the Pattern Generator as described earlier and illustrated in 
Figure 10 where 16 banks of 64 entries per bank are being used. The TSS is provided so as 
to allow more flexibility in the ability to define Waveform Tables for each pin. In the "FP" 
mode the TSS outputs a Timing Set using 2 bits. Thus the TSS will generate a total of four 
5 distinct physical Timing Sets per pin. These Timing Sets are referred to as the Local 
Timing Sets (LTSs). 

[0466] The Frame Processor 1004 combines LTS and WFC and creates an index 1010 
into the Waveform Memory 1012 and Timing Memory 1014. In the "FP" mode the 5 -bit 
value is split up with 2 bits being generated by the LTS and 3 bits being generated by the 
1 0 WFC. Thus the depth of the physical Waveform Memory and Timing Memory is 32 deep 
per pin though a maximum of 4 physical Timing Sets may be used. The Waveform 
Memory contains the enabled timing edges that form the wave shapes. The timing values 
for the enabled edges are obtained from the Timing Memory, Thus, the Frame Processor 
formats wave shapes. 

1 S Mapping Methodology 

[0467] The methodology is to map all the WaveformTable blocks on a per pin basis to 
LTSs in the tester. If tester hardware supports 4 LTSs, the user can define a maximum of 4 
WaveformTable blocks. Each WaveformTable block can have a maximum of n waveform 
definitions for the tester digital module. 

20 [0468] The Timing-Map file provides a mapping of Logical WaveformSeleclors 
defined in the Timing-Map block to the WaveformTable for the module in open 
architecture test system. In this case the tester supports up to 256 Logical 
WaveformSelectors. In open architecture test system system , the Logical 
WaveformSeleclors map directly to the GTSs. The Pattern compiler depends on both the 

25 Timing-Map and the Timing blocks to be able to compile the pattern files. However if the 
waveform characters in the WaveformTables of the Timing block are unchanged or the 
WaveformSelector mappings in the Timing-Map block are unchanged, there is no need to 
re-compile the pattern. 

[0469] Example Using this Mapping Methodology 
30 [0470] To illustrate the mapping into a tester Digital Module the following 

assumptions are made: the Frame Processor is set to the FP mode; and CTV and MTV 
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bits are set so total number of GTS bits is 6 and the total number of Timing Bank Selector 
bits is 4. 

[0471] Each WaveformTable defined in the Timing block is mapped to a distinct LTS 
within the Timing file. This is done on a per-pin basis. Thus WaveformTable seql is 
5 mapped to LTSl. In the case of the "SIG" pin all 8 possible waveform entries are used up. 
However the "CLK" pin requires a single waveform entry and thus uses up a single row in 
the Waveform memory (WFT) and the Waveform Timing memory (WTM). 
[0472] The mapping of the first 2 physical waveforms of the "SIG" pin is illustrated in 
Figure 11. As this WaveformTable maps two waveform characters that need separate 

1 0 configurations of the edges, we end up allocating two entries in the Waveform memory 
(WFT) 1112 and the Waveform Timing memory (WTM) 1114. The shape of the 
waveform is stored in the WFM and the timing details are stored in the WTM. One 
embodiment of the module has a total of 6 timing edges Tl , T2, T3, T4, T5 and T6. These 
map directly to the Events El, E2, ... defined in the waveforms within a Edge Resource 

1 5 section of the Timing block. If more than 6 events are defined in the Timing block and this 
is used with a the above module, it will result in an error. 

[0473] In the example of Figure 11 , the first waveform character "0" uses Timing Edge 
Tl to program the "Force Down" or "D" event, which occurs at time 10ns into the cycle. 
Timing Edge T2 is also used to generate a "Force Down" or "D" event at time 30ns. 

20 Finally Timing Edge T3 is used to generate a "Force Off or "Z" event at time 45ns. 
[0474] The second waveform character "1" uses Timing Edge Tl to program the 
"Force Up" or "U" event, which occurs at time 10ns into the cycle. Timing Edge T2 is also 
used to generate a "Force Down" or "D" event at time 30ns. Finally Timing Edge T3 is 
used to generate a "Force Off" or "Z" event at time 45ns. 

25 [0475] In this fashion, the WFCs are mapped into the WFM memory and WTM 

memory of the Frame Processor. The final setup of Waveform Memory WFM of LTS 1 for 
pin "SIG" is illustrated in Table 2 below. 
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Index 


(WFC) 


TlSet 


TlReSet 


T2Set 


T2ReSet 


T2Drel 


T2Dret 


EXPH 


EXPHZ 


T3Set 


T3ReSet 


T3DreI 


T3Dret 


T4Drel 


T4Dret 


EXPL 


EXPHZ 


0 


0 




1 




1 
















1 










1 


1 


1 






1 
















1 










2 


d 




1 


1 


















1 










3 


u 


I 






1 
















1 










4 


L 






























1 




5 


H 














1 




















6 


m 






























1 




7 


n 














1 





















Table 2 
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[0476] The final setup of Waveform Timing Memory WTM of LTS 1 for pin "SIG" 
illustrated in Table 3 below. 



Index 


(WFC) 


H 


(N 


EXPH 


m 
H 




EXPL 


0 


0 


lOns 


30ns 




45ns 






1 


1 


10ns 


30ns 




45 ns 






2 


d 


12ns 


32ns 




42ns 






3 


u 


12ns 


32ns 




42ns 






4 


L 












17ns 


5 


H 






17ns 








6 


m 












15ns 


7 


n 






15ns 









Table 3 
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[04771 The "CLK" pin uses up a single waveform and thus the WFM and WET for this 
pin are very simple. The final setup of Waveform Memory WFM of LTSl for the "CLK" 
pin is illustrated in Table 4 below. 



Index 


(WFC) 


TlSet 


TlReSet 


T2Set 


T2ReSet 


T2Drel 


T2Dret 


EXPH 


EXPHZ 


T3Set 


T3ReSet 


T3Drel 


T3Dret 


T4Drel 


T4Dret 


EXPL 


EXPHZ 


A 
U 


i 


1 
1 






i 


























1 




































2 




































3 




































4 




































5 




































6 




































7 





































[0478] Table 4 

[0479] The final setup of Waveform Timing Memory WTM of LTS2 is illustrated in 
Table 5 below. 



Index 


(WFC) 




H 


EXPH 


H 




EXPL 


0 


1 


20ns 


40ns 










1 
















2 
















3 
















4 
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6 
















7 
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[0480] Table 5 

[0481] The TimingMap block explicitly maps out the WaveformSelectors to the 
Waveform tables of the Timing block. For a tester system this boils down to setting up the 
Timing Set Scrambler (TSS) memory. The TSS basically contains a mapping from the 
5 GTS to the LTS that holds the settings. The TSS setup for our example for pin SIG will 
look like Table 6 below. 



GTS 


LTS 


0 (wfsl) 


1 


1 (wfs2) 


1 


2 (wfs3) 


2 


3 (wfs4) 


1 


4 (wfs5) 


3 


5 (wfs6) 


1 






N(wfsl) 


1 






255 





[0482] Table 6 

[0483] Finally after the TSS and LTS setup mappings are resolved, the Pattern 
1 0 Compiler can use this information to program the pattern with the correct waveform table 
(LTS) and the correct waveform character to use. Thus our example pseudo-pattern 
considering only pin "SIG" is illustrated in Figure 1 1 . Note that this compilation has no 
dependency on the Timing block and only depends on the Timing-Map block. 

G. Tester Operation 
1 5 [0484] This section describes the basic operation of the tester operating system (TOS). 
The activities considered in this section are: 



system initialization 
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Test Plan loading 
Pattern loading 
Running a Test Plan 
Running an individual Test 

5 

System Initialization 

[0485] In order to initialize the system in one embodiment, certain assumptions must 
be satisfied, and certain conditions must be met. The following sub-section lists these. 

Preconditions 

1 0 [0486] Copies of the relevant system software components have a central store, whose 
location is known to the System Controller. This may be on the System Controller itself, 
or on another system with a network mounted directory (or known to the SYSC via another 
mechanism) — whatever the mechanism, before the system can function, all software must 
be made available to the System Controller for use. This software includes: 

1 5 vendor hardware control (i.e., module software) DLLs, 

standard or user test class DLLs, and 
user test plan DLLs. 

[0487] The system module configuration file is available on the System Controller. 
20 Recall that this file allows the user to specify the physical configuration of the tester, e.g., 
the physical location and type of each module in the system chassis, as well as the names 
of the module software DLLs. 

[0488] The system configuration file is available on the System Controller. Recall that 
this file contains the list of Site Controllers in the system, as well as a map of Site 

25 Controller hostnames to Switch Matrix input port addresses. 

[0489] Site controllers have a service called the Site Configuration Manager (SCM) 
running. This service is responsible for determining what hardware is installed in each slot, 
by a process termed "hardware discovery". It is also responsible for participating in the 
system initialization process with the System Controller. Note that the Switch Matrix 

30 operation protocol dictates, in one embodiment, that the SCM on a single Site Controller, 
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with Switch Matrix input port connection address 1, should always be used to configure 
the Switch Matrix connections to the modules. Recall that this "special" site is denoted as 
SITEC-1. 

[0490] The System Controller is responsible for providing each Site Controller's SCM 
with its Switch Matrix connection address. 

[0491] Each Site controller's SCM is capable of starting a process called the Test Plan 
Server (TPS). The Test Plan Server on each Site Controller is ultimately responsible for 
containing and executing the user's test plan (or test plans, in the case where a single Site 
Controller is running tests on multiple DUTs). 

Initialization Phase I: System Validation 

[0492] Once the above assumptions and preconditions have been satisfied, system 
initialization first proceeds with a system validation step as follows: 

1. The System Controller reads the system and module configuration 
files to initialize the user-specified view of the system. 

2. Using the specified system configuration information, the System 
Controller verifies that the specified Site Controllers are alive, 
reachable, and ready (i.e., have SCMs running). Any error during 
this verification step will cause a system error to be raised, and 
initialization to be aborted. 

3. The System Controller then instructs the SCM service at SITEC-1 to 
configure the switch matrix to have access to all hardware modules, 
and requests it to perform hardware discovery. 

4. The SCM service at SITEC-1 polls all available module slots 
(known hardware locations) for {vendor, hardware} tuples and 
generates a map of {vendor, hardware} tuples to slots. At 
conclusion, this poll has thus identified the entire set of {vendor, 
hardware, slot} bindings that exist in the complete system. The 
results of this poll are sent to the System Controller. 

5. The System Controller verifies that the results of the above hardware 
discovery step match the user-specified configuration in the module 
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configuration file. Any error during this verification step will cause 
a system error to be raised, and initialization to be aborted. 

6. The System Controller then loads a default environment (such as 
search paths for module DLLs, pattern lists, patterns, test plan DLLs, 

5 test class DLLs, etc.) from the environment setup file(s) at well- 

known location(s). 

7. The System Controller ensures that all identified module software 
DLLs exist. If one is not available on the System Controller, it is 
retrieved from the central store, if possible; otherwise, a system error 

1 0 is raised, and initialization is aborted. 



Initialization Phase II: Site Configuration (Optional) 

[0493] Site configuration, or site partitioning, involves the software-level assignment 
of the available system hardware modules to different sites (i.e., to service multiple DUTs). 

1 5 Recall that site-partitioning information is provided in a socket file. 

[0494] The tester system allows site (re-)partitioning to be performed both as part of a 
test plan load (since each test plan is associated with a particular socket), and as an 
independent user-callable step. In the latter case, the user initiates the site partitioning by 
providing a socket file that is used solely to partition the system. This is especially useful 

20 during system initialization in the case of multi-DUT testing where each site tests a 

different DUT type. However, this step is optional during the initialization stage, and the 
user can choose not to have it performed, opting instead to allow a test plan load to 
partition the system appropriately. 

[0495] Whatever the means chosen to effect site partitioning (by an independent call or 
25 implicitly through a test plan load), the mechanism is the same. This mechanism is 
described below. 

1 . Given the socket, the System Controller first determines whether the 
currently existing system partition is compatible with the socket, or 
whether a re-partitioning is necessary. The default partition during 
30 initialization is one in which all available modules are connected to 
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SITEC-1. The remaining steps below are performed only if re- 
partitioning is needed. 

2. The System Controller sends a configuration message to each Site 
Controller SCM to re-configure itself with the number and identities 

5 of DUT sites that are enabled for it under the new socket. Note that 

this is a general procedure, and handles the case where the number 
of DUT sites controlled by a Site Controller is one. The new socket 
information is also conveyed to the SCMs. 

3. Each SCM stops the running TPS, if any, and starts a new one, 

10 initializing it with the new socket, and the number and identities of 

DUT sites that are enabled for it imder the new socket. 

4. The System Controller determines which sites need what subsets of 
the required system modules. While doing this, it also prepares 
hardware slot information for the sites. The net result is, for each 

1 5 site, a list of slots versus module DLLs assigned to that site. This 

site-specific list will be denoted as the Site Module DLL Slot List 
(SITE-MDSL). 

5. The System Controller provides the appropriate SITE-MDSL, as 
well as the necessary module DLLs, to each SCM. Each SCM in 

20 turn makes this information available to the newly-started TPS. 

6. The System Controller then requests SITEC-1 to configure the 
Switch Matrix for the proper site-to-slot connections, that is, for site- 
partitioned operation. 

7. The TPSs on sites 1 through n load the DLLs specified in th^ir 

25 SITE-MDSL. Each of these DLLs has a function named initialize() 

which takes an array of slot numbers. The TPS calls initializeQ with 
the appropriate slot lists for that module type. On any malfunctions 
at this point, a system error is raised, and initialization is aborted. 
The initializeQ method does the following: 

30 a. Creates concrete classes based on a standard interface 

IXXXModule. For example, a DLL associated with a digital 



wo 2005/114240 PCT/JP2005/009815 

174 

module will create a single IPinModule-based object to service each 
slot it is associated with. 

b. Creates concrete classes based on interface IResource, 
one for each "resource unit" in the module. Again, for a digital 
module, each IPinModule-based object will create ITesterPin-based 
objects for all pins in the collection of slots occupied by digital 
modules. 

8. The TPSs on sites 1 through n then call getXXXModule() on each 
loaded module DLL to retrieve module contents information. 

9. Each call to getXXXModuleQ returns a 
<VendorHWTYpe>Module class object as an IModule pointer 
(e.g., AdvantestPinModule). Each such IModule pointer is 
cached by the TPS, which makes these available to framework/user 

■code. Note that the collection of IModules, IResources, etc. are 
persistent (at least for the lifetime of the TPS). 

10. Once the above steps are complete, the TPS starts to listen() on its 
assigned (well-known) port. This signals to the System Controller 
that the TPS is "ready" to begin normal (i.e., site-partitioned) 
operation. 

Test Plan Load 

[0496] This section describes the steps by which a user Test Plan DLL is loaded on a 
Site Controller (for single or multiple DUT testing). 

[0497] Once system initialization (and optionally, initial site partitioning) has been 
completed, user test plans can be loaded. The loading of a user test plan on a Site 
Controller proceeds as follows: 

1 . The System Controller first loads the test plan DLL into its ovm 
process space, querying it for its associated socket file and its DUT 
type identifier. This information is used to identify the site(s) 
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running this test plan, and hence, the Site Controller(s) that this test 

plan would be loaded on. 

2. The System Controller then uses the socket information associated 
with the test plan to initiate the re-partitioning process as outlined 
above. 

3. The System Controller extracts the list of test class DLLs used by 
the test plan from the test plan DLL, and once the System Controller 
has verified that the TPS is ready to begin normal (i.e., site- 
partitioned) operation, sends the test class DLLs, and, finally, the 
test Plan DLL itself, to the appropriate TPS. 

4. The TPS calls LoadLibraryQ to load it into its process space. It calls 
a well-known function on the DLL to create as many TestPlan 
objects as the number of sites (i.e., DUTs) it is servicing. 

5. The TPS initializes the TestPlan object(s) with the necessary tester 
framework objects. During initialization, the TPS loads the 
appropriate DLLs for the test classes used by the TestPlan object(s) 
into the process space, and creates the test class instances. 

6. The TPS sets up the commtmications channel to/from the System 
Controller to the TestPlan object(s). 

7. The System Controller communicates with the TPS, and builds its 
proxies for the TestPlan object(s). 

[0498] The concludes the successful load of the user's Test Plan on a Site Controller. 
Running a Test Plan 

[0499] The method to execute all tests in a test plan according to the pre-defined flow 
logic is as follows: 

1. The user's application transmits a RunTestPlan message to the TPS. 
The TPS sends an ExecutingTestPlan message to all connected 
applications. The TPS then calls executeQ on the Test Plan. 
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2. Testing multiple DUTs with a single Site Controller is performed 
using multiple threads on that Site Controller, one per DUT. Each 
thread runs a different, independent instance of the same 
TestPlan object. Since, in this case, module control software 
DLLs might be sheired across DUTs, the module commands for 
hardware communication are required to take a DUT identifier 
parameter. 

3. The TestPlan object iterates over each test in its collection 
(alternatively, tells its Flow object to process each test according to 
the flow logic), calling preExecQ, executeQ, and postExecQ. 

4. As each test executes, status messages are sent back to all connected 
applications. 

Executing a Single Test 

[0500] A user may wish to execute a single test in a test plan instead of all tests. For 
single test execution, the method is as follows. 

1 . User application transmits a RunTest message to the TPS; the TPS 
sends an ExecutingTest message to all cotmected applications. The 
TPS then calls executeTestQ on the Test Plan, specifying the test to 
run. 

2. The Test Plan object executes the specified test by calling preExec(), 
executeQ, and postExecQ on that test object. 

3. When the test executes, it sends status messages back to all 
connected applications. 

H. Module Control Software 

[0501] The open architecture test system of an embodiment of the present invention 
uses minimally sufficient interfaces at the test system framework level. The test system 
framework is designed to operate upon vendor modules that follow a set of standard 
interfaces. Whenever a module vendor integrates a new module component into the test 
system, the new component preferably provides the predefined standard interfaces to the 



wo 2005/114240 PCT/JP2005/009815 

177 

test system as required. This allows for seamless integration of the vendor modules into 
the system in a plug-and-play manner. 

[0502] Figure 1 3 illustrates a method for integrating a vendor software module to the 
open architecture test system according to an embodiment of the present invention. The 
vendor software module 1302 includes a resource description component 1304, a driver 
component 1306, a calibration/diagnostic component 1308, an emulation component 1310, 
an optional system loadable pattern compiler component 1312, and a system loadable 
module specific component 1314. As shown in box 1307, each component preferably 
comprises: 1) at least one executable component (that the system uses at runtime), 2) 
public header files (i.e., C++ ".h" files) that define the component's API and all associated 
documentation, and 3) system component configuration records (CCRs) for the component. 
The CCRs allow the test system's installation and configuration management sub-system 
to manage and deploy the required versions of the elements that constitute the component. 
Each component may also include documentation (Docs), and application examples 
(Examples) of the components. 

[0503] The open architecture test system 1 320 includes a set of standard interfaces 
1322, which in turn includes a calibration/diagnostic framework 1324, an emulation 
framework 1326, and an object file manager (OFM) framework 1328. Both the standard 
interfaces 1322 and the individual frameworks of the test system communicate with the 
corresponding category of software components in the vendor module software 1302. 
[0504] The executable of a vendor's component requires that it be loaded and used 
during runtime. In particular, the requirements include: 

1 . h is provided in the form of a dynamic link library (DLL). Each of the above 
components is in a separate DLL for purpose of modularity and maintainability. 

Furthermore, 

a. The module DLL preferably implements the standard system module DLL 
interface, which is the basic interface for retrieving intrinsic module 
information, such as the module type, exported resources, etc. 

b. The module DLL can export only a single module type. 

2. A version of the DLL is described by the vendor in a CCR. 

3. The user includes the version of the DLL in a system profile, which is the total 
collection of information necessary to define a particular system software 
configuration. This causes the DLL specifications for the driver, emulator, 
calibration, diagnostics, and pattern compiler executable components to be 
generated in the system Module Configuration File (MCF) and the system 
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Utilities Configuration File (UCF). These files are used by the system during 
runtime to find the components to be loaded. 

[0505] Once the vendor and the user (in case 3) have satisfied the above requirements, 
5 the system can prepare to load the specified executable component. 

[0506] The standard interfaces to the test operating system (TOS) are defined as 
abstract C++ classes. Modixle-specific software for the system is required to be provided 
in the form of DLLs, which can be independently and dynamically loaded by the system 
software at runtime. Each such software module is responsible for providing vendor- 

10 specific implementations of the system module interface commands, which comprise the 
application programming interface (API) for module software development. 
[0507] Note that supporting the standard interfaces does not mean that each module 
software component needs to provide only the functionality represented by the system 
standard interfaces the modules comply with. On the contrary, vendors are free to add one 

1 5 or more complex layers of functionality on top of the system standard interfaces as 

required for implementing their modules. However, the system framework is not able to 
access the additional fimctionality. It is the responsibility of the users and vendors to 
interpret and take advantage of the additional functionality, above and beyond the 
predefined capabilities provided by the framework and the TOS. Thus, the users of the test 

20 system are free to use the specific features and custom extensions provided by module 
vendors. The tradeoff is that using custom extensions may provide more functionality to 
the specific vendor modules, but the custom extensions make the specific vendor modules 
and their associated test programs less useable with other vendors' modules. 
[0508] Figure 14 illustrates a module control framework according to an embodiment 

25 of the present invention. The module control framework includes a module interface 
(IModule) 1402, a resource interface (IResource) 1404, and a resource group interface 
(IResourceGroup) 1406. The IModule 1402 may optionally include a pattern list module 
interface (IPattemListModule) 1408, a domain module interface (IDomainModule) 1410, 
and a cyclized module interface (ICyclizedModule) 1412. Similarly, the IResource 1404 

30 may optionally include a cyclized resource interface (ICyclizedResource) 1414 and a 
cyclized resource group interface (ICyclizedResourceGroup) 1416, which vendors can 
choose to implement to provide special functionalities indicated by the chosen interface. 
Each of the interfaces is discussed in detail below. 
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IModuIe Interface 

[0509] The relationship between a hardware module type and its corresponding 
software object is defined by the IModule interface 1402. In other words, the IModule 
interface implements the system standard interface that represents a particular hardware 
module type, and encompasses the individual units of that module type connected to a site 
controller. The IModule interface 1402 declares user-level methods to obtain module 
information, retrieve resources, and resource groups. User can apply this interface at the 
vendor level in order to utilize vendor-specific features provided by the vendor module. In 
one embodiment, the IModule interface 1402 includes the following methods. 

• getResourceQ: This method retrieves a module resource by resource name. 

• getResourcesQ: This method retrieves all module-instantiated resources of a 
particular type. 

• getResourceGroupsQ: This method retrieves all module-instantiated resource 
groups of a particular type. 

• getResourceGroup(): This method retrieves an existing resource group by its name. 

IResource Interface 

[0510] A specification of a hardware resource (or resource for short) is used to 
describe hardware module functionality in a way that can be supported by the system 
framework for all modules. A resource is a logical collection of one or more functional 
hardware entities that can be controlled as a single, independent object. A resource unit is 
typically provided by the module. An example of a resource unit is a single digital tester 
pin provided by a DM250MHz board that is cormected to a single output port of the system 
Module Connection Enabler (MCE). The relationship between a hardware resource unit 
and its corresponding software object is that the software object implements the resource 
interface representing a single logical unit of a particular resource type. 
[0511] Each compliant hardware module provides one or more types of resources used 
by the test system. A hardware module is a vendor-provided hardware entity that contains 
a vendor-specified module type and is connected to an output port of the system MCE. 
The MCE provides units of the one or more resources as necessary. Note that units of 
modules of the same type can occupy as many port connections on the MCE as required. 
The type of a module is unique within a particular vendor's offerings. 
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[0512] The Resource Definition Language is used to declare a set of resource names 
for the available resource types, and a set of attributes and types associated with each 
particular resource type. It is through the setting of parameter values that the vendor 
supports the configuration of its hardware resources. As an example, the. resource name 
5 "Digital. dpin" is used to refer to digital tester pins. These resources have parameters such 
as VIL (for the input low voltage), VIH (for the input high voltage), VOL (for the output 
low voltage), VOH (for the output high voltage), etc. Thus, each resource has attributes 
that are defined by the system or the resource vendor, which can be used within the set of 
attributes of the resources. 

1 0 [0513] A system Resource Definition File contains resource declarations in the system 
resource definition language. The system specifies certain standard resource names, which 
are available in a standard system file. Vendors supplying special purpose resources that 
require the specification of different parameters are required to provide their own resource 
definition files, and place them in predefined locations. The system treats the parameters 

1 5 defined in the resource definition file as strings, to be passed on to the vendor-specific 

software as-is. It is the responsibility of the vendor-specific module software to interpret 
these strings as the intended parameters, and to provide specific APIs, if necessary, by 
which test programs can make use of these extensions. 

[0514] In the object model, each resource imit implements the IResource interface. In 
20 support of its particular functionality, the module that provides such a resource can 

implement an object that exposes an interface derived fhjm the IResource interface, which 
is used to communicate v\dth the test system. The IResource interface allows the test 
classes provided by the vendor or user to incorporate additional functionalities without 
recompiling the tester operating system, thereby providing users more flexibility in testing 
25 the modules and their corresponding DUTs. The Module interface of a particular resource 
may create as many IResource objects as specified in the socket description of a particular 
test program. 

[0515] Since every resource unit stores a type, a port-ID, and a charmel-ID for 
identification purposes, an IResource object represents a single unit of a particular resource 
30 type is uniquely identifiable in the entire system by the parameters {type, port-ID, channel- 
ID}. This parameter is the specification "port-ID. channel-ID" defined in the system 
module configuration file (MCF). The "port-ID" and "channel-ID" elements for a 
particular resource unit are available from the socket object (which provides a mapping 
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from DUT pin names to loadboard connections, and the loadboard connections are mapped 
to the "port-ID.channel-ID" specification through a resource-type-specific block in the 
TestHeadConnections section of the MCF). 

[0516] Note that the test system supports a shared resource, which can be made 
5 available to more than one DUT pin, for any combination of the set of DUT pins at any 
given time. The test system also supports the connection of a single DUT pin to multiple 
resource units, vsdth the restriction that no more than a single unit of a resource type 
(except power supply) may be connected to the same DUT pin. 
[0517] In one embodiment, the IResource interface 1404 includes the following 
10 methods. 

• getAttributeCache(): This method retrieves the attribute cache associated with this 
resource. 

• getNameQ: This method retrieves the name of this IResource, 

• getChannellDQ: This method retrieves the HW channel ID for the resource. 

1 5 • getPortlDQ: This method retrieves the switch matrix port ID for the resource. 

• getTypeQ: This method retrieves the TPL type of the resource (e.g., "Digital.dpin", 
etc.). 

• getConnectedDUTPins(): This method retrieves the set of connected DUT pin 
names (useful for a shared resource). 

20 • getModuleQ: This method retrieves a pointer to the IModule that created this 

IResource. 

• getAllAttributes(): This method retrieves the list of name/type information for all 
attributes for this resource. 

• getAll Attribute Values(): This method retrieves the list of full information for all 
25 attributes for this resource. 

• getAttribIntVal(): This method retrieves the integer value of an attribute (if 
appropriate). 

• getAttribUIntVal(): This method retrieves the unsigned integer value of an 
attribute (if appropriate). 

30 • getAttribDblValO: This method retrieves the double value of an attribute (if 

appropriate). 
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IResourceGroup Interface 

[0518] The IResourceGroup interface 1406 represents the collective behavior of a set 
of IResources. It is an interface exposed to IModules that allows the user to specify a 
5 collection of IResources and subsequently use the collection as a single resource unit. 
While the IResourceGroup contains the set of IResources used to create the 
IResourceGroup, it provides a unified programming interface to the collection as a whole. 
For example, a particular vendor may have a hardware-supported mechanism to broadcast 
an attribute setting call on an IResourceGroup to all the members of IResources at the 

10 same time, without individually calling the attribute setting method on each member. 

[0519] In the test system, a resource group is created by the system whenever the user 
defines a group of DUT pins in a signal. This implicit construction is the way in which a 
resource group is created. An IResourceGroup can only be homogeneous, i.e., containing 
IResources of the same type (defined by the test program language (TPL)), such as the type 

1 5 "Digital.dpin" or "PowerSupply.dps," but not both. The creator of an IResourceGroup 
from a given collection of IResources enforces this requirement. 

[0520] An IResourceGroup is uniquely identified in the system by the following set of 
parameters. 

DUT-pin-group-name, resource-type, vendor-ID, module-ID 

20 

[0521] Note that the IModule interface is required to provide the IResourceGroup 
interface, whether hardware support is available or not. In the absence of true hardware 
"resource groups," a software equivalent of the functionality is provided. In addition, the 
IModule interface provides a "virtual constructor" for creating an IResourceGroup with a 
25 homogeneous collection of IResources. This is enforced by the createResourceGroupQ 
method of the IModule interface. 

[0522] In one embodiment, the IResourceGroup interface includes the followin'g 
methods. 

• getName(): This method retrieves the name of this group. 

30 • getMembersQ: This method retrieves the collection of IResources comprising this 

group. 

• getModuleQ: This method retrieves a pointer to the IModule that created this 
group. 
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• getType(): This method retrieves the TPL type of the IResources comprising this 
group, e.g., "Digital.dpin," etc. 

• getAttributeCache(): This method retrieves the attribute cache for the resource type 
for this group. 

5 • getAlIAttributesQ: This method retrieves the list of name/type information for all 

attributes for the resource type for this group. 

IPatternListModule Interface 

[0523] The IPatternListModule interface 1408 is a specialization of the Module 
1 0 interface, and represents a hardware module that supports the manipulation of test pattern 
objects. It includes the following methods. 

• getNumberOfLoadedPattems(): This method retrieves the number of loaded 
patterns. 

• getPattemlDsQ: This method gets loaded pattern ID array. 

1 5 • getPattemListlDsQ: This method gets array of Pattern Lists loaded into module. 

IDomainModuIe Interface 

[0524] The IDomainModuIe interface 1410 is a specialization of IPatternListModule 
interface 1408, and represents a hardware module that supports the functionalities required 
for the time domain (such as a group of resources clocked at a particular frequency). It 
20 implements the following methods. 

• getVendorDomainQ: This method retrieves a vendor domain object by identifier. 

• getVendorDomainQ: This method retrieves a vendor domain object by name. 

• getVendorDomainsQ: This method retrieves the collection of all vendor domain 
objects instantiated by this module. 

25 • getVendorDomainsForPattemQ: This method retrieves the collection of all the 

vendor domains associated with the given pattern. 

ICycIizedModule Interface 



30 



[0525] The ICyclizedModule interface 1412 provides an interface for a cyclized 
module. It includes the following methods. 
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• getCyclizedAddressFailMemoryQ: This method obtains the module address fail 
memory object pointer. 

• getCyclizedFailMemoryQ: This method obtains the module fail memory object 
pointer. 

• getCyclizedResource(): This method retrieves a cyclized resource by its name. 

• getCyclizedResourceGroupQ: This method retrieves a resource group by its name. 

ICyclizedResource Interface 

[0526] The ICyclizedResource interface 1414 extends the standard IResource interface 
with functionality specific to cyclized resources. A cyclized resource contains elements 
with timing attributes, such as components related to the system timing, timing map, and 
cyclized digital pattern data. The ICyclizedResource provides the function of exporting an 
ICyclizedAttributeCache, which allows the system framework to work with TCM settings 
for system timing and timing map attributes. In addition, the ICyclizedResource allows the 
user to retrieve the timing and timing maps attributes in use. 
[0527] In one embodiment, the ICyclizedResource interface 1414 includes the 
following methods. 

• getCyclizedAttributeCacheQ: This method retrieves the cache object that allows 
the application of timing and timing map attributes to hardware. 

• getTimingDataQ: This method retrieves the timing data currently set on the 
resource unit. 

• getTimingMapData(): This method retrieves the timing map-related attributes that 
are currently set on the resource. 

• setTimingDataQ: This method sets the timing-related attributes on this cyclized 
digital resource. This sets all the contents of a single waveform, as defined in the 
TPL Timing language. 

• setTimingMapDataQ: This method sets the timing map-related attributes on this 
cyclized digital resource. 
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ICyclizedResourceGroup Interface 



PCT/JP2005/009815 



[0528] This ICyclizedResourceGroup interface 1416 provides a specialized 
IResourceGroup interface for grouping ICyclizedResources. It includes the following 
methods. 

• getCyclizedAttributeCache(): This method retrieves the cache object that allows 
the application of timing and timing map attributes to hardware. 

• setTimingDataQ: This method sets the timing-related attributes on this cyclized 
digital resource group. This sets all the contents of a single waveform, as defined 
in the TPL Timing language. 

• setTimingMapDataQ: This method sets the timing map-related attributes on this 
cyclized digital resource group. 

Module Initialization 

[0529] The driver DLL of a vendor module is automatically loaded by the test system 
on the site controllers that need it. The term module DLL refers to the module driver DLL 
in this context. In one embodiment, a module initialization flow is shown below, which 
happens after the main service processes on the system and site controller(s) have been 
started. In offline mode, the module bring-up starts after the simulation framework 
executable (the Simulated Tester, or SimTester) has been started. 

1. The system controller initializes itself, and establishes connections with the 
site controllers. 

2. The system controller loads the system MCF. 

3. The system controller initiates the process of hardware discovery on the 
master site controller (i.e., site controller 1), the one that is connected to 
input port 1 of the system Module Connection Enabler. This hardware 
information is used to create the system Hardware Inventory File on the 
system controller. 

4. The system controller validates the MCF against the information obtained 
through hardware discovery. 

5. The system controller then performs validation of all module software as 
follows: 
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a. It finds the module DLLs that are specified in the MCF, using a 
search path for such DLLs. 

b. It loads each module DLL (the module DLL preferably implements 
the interface). 

5 c. It verifies (using a standard method exported by the DLL) that the 

resources declared in the MCF for that module can be created by the 
module. 

6. The system controller then populates all the site controllers (other than the 
master) with module configuration information. This information is used 

1 0 later for module object construction. 

7. The system controller prepares for a default partitioning of the system 
(where every module is connected to the master site controller). This state 
is modified for system calibration. 

1 5 [0530] Once a default partitioning has been performed, the system as a whole is in the 
initialized state. 

Module Setup and Access 

[0531] In another embodiment, the sequence of events leading to a successful, non- 
default system partition are shown below. Since partitioning information is specified in a 
20 socket file, it is assumed that the proper socket file has been read, and a socket object 
based on the socket file has been created. 

1. The system controller instructs the master site controller to configure the 
system MCE according to the partition specified in the socket. 

2. Each site controller then loads the module DLLs and constructs module 
25 objects, each of which preferably implements the standard interface 

IModule. The process is as follows: 

a. The module DLL is transferred from the system controller to the site 
controller. 

b. The module DLL is loaded in the process space of the site controller 
30 service process. 
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c. All Module object is created on the module DLL interface. The vendor 
assumes the responsibility for the creation of vendor-specific objects. In 
this step, the vendor also performs any internal initiaUzation steps 
required. 

3. Each site controller initializes the IModule object created above, by calling 
the initializeO method. The parameters for this method are used as 
references to the socket object, to any vendor-specific data described in the 
MCF, and to a list of identifiers of the DUTs being tested (in a parallel test 
envirotunent). In this step, the IModule object creates and initializes the 
IResource unit objects that are made available to the test system. 



[0532] The site controller system software maintains the collection of properly 
configured and initialized IModule, and uses it for test operations, such as test plan loading, 
pattern loading, test plan execution, fail data retrieval, etc. It also allows system objects, 
user test classes, and vendor objects to interact with the IModule and the IResource 
provided. In one embodiment, the following steps illustrate a method for a user test class 
to access resource imits at runtime (the client referred to below is a user test class): 

1. A client, in its postExec() method, needs to perform datalogging of the 
current values of pin attributes set on the hardware, for the DUT pin group 
GO, which contains the pins AO and Al . 

2. The client, which is executing on a Site Controller, retrieves the Signal 
(which are framework-provided objects encapsulating the relationships 
between DUT pins and connected hardware resource units) corresponding 
to DUT pin group GO from the test plan. 

3. The client uses the method Signal::getResources() to retrieve the 
IResourceGroup pointer from the signal for GO. 

4. The client uses the IResourceGroup: :getMembers() method to extract the 
IResources in it (i.e., the resource units connected to DUT pins AO and Al). 

5. Given that the cyclized modules and resources have been used, the client 
uses a C++ dynamic_casto operator to cast the IResource pointers to 
ICyclizedResource pointers. 
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6. Through each ICyclizedResource pointer, the client retrieves, for example 
timing data, by using the ICyclizedResource ::getTimingData() method. 

7. The client datalogs .the timing attribute values retrieved above. 

[0533] The disclosed method for controlling interchangeable components allows a new 
module type to be added to the test system transparently, without recompiling the test 
operating system. Thus, the disclosed method supports an open architecture test system for 
integrating fully re-configurable and interchangeable vendor module components, with 
their associated hardvrare and software. Thus, the method supports vendor modules in a 
plug-and-play fashion, after such modules have been independently specified, developed 
and certified. This provides the end user a flexible, modular, re-configurable, and highly 
scalable open architecture test system that reuses vendor modules for testing and lowers 
the cost of testing integrated circuits. 

[0534] One skilled in the relevant art will recognize that many possible modifications 
and combinations of the disclosed embodiments may be used, while still employing the 
same basic underlying mechanisms and methodologies. The foregoing description, for 
purpose of explanation, has been written with references to specific embodiments. 
However, the illustrative discussions above are not intended to be exhaustive or to limit the 
invention to the precise forms disclosed. Many modifications and variations are possible 
in view of the above teachings. The embodiments were chosen and described to explain 
the principles of the invention and their practical applications, and to enable others skilled 
in the art to best utilize the invention and various embodiments with various modifications 
as are suited to the particular use contemplated. 
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CLAIMS 

What is claimed is: 

1 . A method for integrating test modules in a modular test system, comprising: 

5 controlling at least one test module and its corresponding device under test (DUT) 

with a controller; 

establishing a standard module control interface between a vendor-supplied test 
module and the modular test system with a module control framework; 

installing the vendor-supplied test module and a corresponding vendor-supplied 
10 control software module, wherein the vendor-supplied control software module is 
organized into a plurality of vendor-supplied module control components; 

configuring the modular test system based on the module control framework and 
the plurality of vendor-supplied module control components; and 

accessing the vendor-supplied test module in accordance with the plurality of 
1 5 vendor-supplied module control components using the module control framework. 

2. The method of claim 1, wherein the module control framework comprises: 

a module class for representing a hardware module type of the vendor-supplied test 
module; 

a resource class for representing a logical unit of a particular resource type of the 
20 vendor-supplied test module; and 

a resource group class for representing a group of individual resource units having 
a unified interface among the individual resource units. 

3. The method of claim 2, wherein the module control framework further comprises: 
a pattern list module class for supporting patterns and pattern lists; 

25 a domain module class for retrieving vendor domain objects; and 

a cyclized module class for retrieving cyclized resources. 

4. The method of claim 2, wherein the module control framework further comprises: 
a cyclized resource class for supporting vendor-supplied test modules with timing 

attributes; and 

30 a cyclized resource group class for representing a group of individual cyclized 

resource units. 

5. The method of claim 1, wherein the module control framework further comprises: 
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a system resource definition language for supporting custom configuration of 
vendor-supplied hardware resources; and 

a system resource definition file for storing vendor-supplied special purpose 
resources. 

5 6. The method of claim 5, wherein the system resource definition language is used to 
define: 

a set of resource names for a corresponding set of resource types; and 

a set of parameter names and types for the corresponding set of resource types. 

7. The method of claim 1, wherein the plurality of vendor-supplied module control 
10 components comprise: 

a resource description component; 
a driver component; 
a diagnostic component; 
a calibration component; and 
1 5 an emulation component. 

8. The method of claim 7, wherein the plurality of vendor-supplied module control 
components further comprise: 

a pattern compiler component; and 
a module-specific component. 
20 9. The method of claim 1, wherein the plurality of vendor-supplied module control 
components are executable components in the format of dynamic link library. 

10. The method of claim 1, wherein the plurality of vendor-supplied module control 
components are provided in a component configuration record. 

11. The method of claim 1, wherein configuring the modular test system comprises: 
25 initializing a system controller; 

establishing cormections between the system controller and the at least one site 
controller; 

loading a system module configuration file to the system controller; 
discovering hardware devices connected to the modular test system; 
30 storing discovered hardwjire information in a hardware inventory file on the system 

controller; 

validating the system module configuration file against the hardware inventory file; 
validating the vendor-supplied control software module; 
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populating the at least one site controller with the system module configuration file; 

and 

partitioning the modular test system. 

1 2. The method of claim 1 1 , wherein validating the vendor-supplied control software 
5 module comprises: 

locating a module dynamic link library specified in the system module 
configuration file; 

loading the module dynamic link library; and 

verifying resources declared in the system module configuration file can be created 
1 0 by the corresponding vendor-supplied control software module. 

13. The method of claim 11, wherein partitioning the modular test system comprises: 
reading a socket file, wherein the socket file comprises user-specified system 

partition information; 

configuring a system module connection enabler in accordance with the socket file; 
1 5 loading a corresponding module dynamic link library at each site controller; 

creating a standard module control interface in accordance with the corresponding 
module dynamic link library; and 

initializing the standard module control interface at each site controller. 

14. A modular test system, comprising: 

20 a controller for controlling at least one test module and its corresponding device 

under test (DUT); 

a module control firamework for establishing a standard module control interface 
between a vendor-supplied test module and the modular test system; 

means for installing the vendor-supplied test module and a corresponding vendor- ' 
25 supplied control software module, wherein the vendor-supplied control software module is 
organized into a plurality of vendor-supplied module control components; 

means for configuring the modular test system based on the module control 
framework and the plurality of vendor-supplied module control components; and 

means for accessing the vendor-supplied test module in accordance with the 
30 plurality of vendor-supplied module control components using the module control 
framework. 

15. The system of claim 14, wherein the module control framework comprises: 
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a module class for representing a hardware module type of the vendor-supplied test 
module; 

a resource class for representing a logical unit of a particular resource type of the 
vendor-supplied test module; and 
5 a resource group class for representing a group of individual resource units having 

a unified interface among the individual resource units. 

1 6. The system of claim 15, wherein the module control framework further comprises: 
a pattern list module class for supporting patterns and pattern lists; 

a domain module class for retrieving vendor domain objects; and 
1 0 a cyclized module class for retrieving cyclized resources. 

1 7. The system of claim 1 5, wherein the module control framework further comprises: 
a cyclized resource class for supporting vendor-supplied test modules with timing 

attributes; and 

a cyclized resource group class for representing a group of individual cyclized 
1 5 resource units. 

1 8. The system of claim 14, wherein the module control framework further comprises: 
a system resource definition language for supporting custom configuration of 

vendor-supplied hardware resources; and 

a system resource definition file for storing vendor-supplied special purpose 
20 resources. 

19. The system of claim 18, wherein the system resource definition language is used to 
define: 

a set of resource names for a corresponding set of resource types; and 

a set of peirameter names and types for the corresponding set of resource types. 
25 20. The system of claim 14, wherein the plurality of vendor-supplied module control 
components comprise: 

a resource description component; 

a driver component; 

a diagnostic component; 
30 a calibration component; and 

an emulation component. 
21 . The system of claim 20, wherein the plurality of vendor-supplied module control 
components further comprise: 
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a pattern compiler component; and 

a module-specific component. 
22. The system of claim 14, wherein the plurality of vendor-supplied module control 
components are executable components in the format of dynamic link library. 
5 23. The system of claim 14, wherein the plurality of vendor-supplied module control 
components are provided in a component configuration record. 

24. The system of claim 14, wherein the means for configuring the modular test system 
comprise: 

means for initializing a system controller; 
10 means for establishing connections between the system controller and the at least 

one site controller; 

means for loading a system module configuration file to the system controller; 
means for discovering hardware devices connected to the modular test system; 
means for storing discovered hardware information in a hardware inventory file on 
1 5 the system controller; 

means for validating the system module configuration file against the hardware 
inventory file; 

means for validating the vendor-supplied control software module; 
means for populating the at least one site controller with the system module 
20 configuration file; and 

means for partitioning the modular test system. 

25. The system of claim 24, wherein the means for validating the vendor-supplied 
control software module comprise: 

means for locating a module dynamic link library specified in the system module 
25 configuration file; 

means for loading the module dynamic link library; and 

means for verifying resources declared in the system module configuration file can 
be created by the corresponding vendor-supplied control software module. 

26. The system of claim 24, wherein the means for partitioning the modular test system 
30 comprise: 

means for reading a socket file, wherein the socket file comprises user-specified 
system partition information; 
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means for configuring a system module connection enabler in accordance with the 
socket file; 

means for loading a corresponding module dynamic link library at each site 
controller; 

means for creating a standard module control interface in accordance with the 
corresponding module dynamic link library; and 

means for initializing the standard module control interface at each site controller. 



wo 2005/114240 



PCT/JP2005/009815 



1/14 



6 



8 



16 



10 



12 



14. 



Data Rate 



Pattern 
Memory 
Data 



Data 
DATA 



Action 
"0" J 



.Timing^ 



Mi|l 




Waveform 



Waveform 
Data 



ACTION 




-To 
DUT 



Action = Pattern Data * Timing Data (Limited by TimeSet) 

Waves 



Figure 1 



wo 2005/114240 



PCT/JP2005/009815 



2/14 



100 



102 



□ 



System Controller 



104 



Site Controller 
1 



106 



mPorti 



Site Controller 
2 



In Port 2 



Site Controller 
3 



In Port 3 



Site Controller 
n 



In Port » 




Module 
Connection 
Enabler 





Out Port 1 



Out Port m 



108 110 



Module 



Module 



Test Site 1 



1-U 



114 

Loadboard . 11 



DUT 



Module 



Module 



Test Site 2 



Loadboard 



DUT 



Module 



Module 



Test Site 3 



Loadboard 



DUT 



Module 



Module 



Test Site n 



Loadboard 



DUT 



Figure 2 



wo 2005/114240 



PCT/JP2005/009815 



3/14 



200 




Figure 3 



wo 2005/114240 



PCT/JP2005/009815 



4/14 



TPL Compiler 




Translation 
402 



C++ 


C++ 




Compiler 




406 



DLLs 



Figure 4 



wo 2005/114240 



PCT/JP2005/009815 



5/14 



502 



TestTypeX 



504 



Instancel 



Data for Instance. 1 



^ J 

4 



In8tance2 



Data for Instance 2 




Data for instance. 3 



Figure 5 



wo 2005/114240 



PCT/JP2005/009815 




wo 2005/114240 



PCT/JP2005/009815 




Figure 7 



wo 2005/114240 



PCT/JP2005/009815 



8/14 




Figure 8 



wo 2005/114240 



PCT/JP2005/009815 



9/14 



includes" 



Pin. Des^dytlori File 




reference 



uses 1^^^^^^^ 
Socket File 



Pattern object 



Test P an File 



Includes' 



Pin 

• Waveform Tables 
- period 
-waveforms 
- time; event; wfc 



includes 



U 



Timing File 
includes 

^ ^ 



■Includes 



uses 



TestCondltionGroup 

.-i I 
File 
I 

includes 



\ reference 
s 




Specs Source File 



Pattern Source File 



Timing Map. File 



Figure 9 



wo 2005/114240 



PCT/JP2005/009815 



10/14 




wo 2005/114240 



PCT/JP2005/009815 



11/14 



iOj{ D@10ns; D@30ns; Z@45ns ; } 
j3{ U@10ns; D@30ns; Z@45ns ; } 



— 0 


T1 ReSet, T2 ReSetT3 Dret 


0 


T1 10n8,T2 30n8T345n8 




1 


T1 Set, T2ReSetT3 Dret 




T1 10ns, T2 30ns T3 45ns 




2 




2 






3 




3 






4 




4 






5 




5 






6 




6 






7 




7 








Waveform Memory 
1112 




Timing Memory 
1114 



Figure 1 1 



wo 2005/114240 



PCT/JP2005/009815 



12/14 



NOP V{SIG=1;CLK=1} W{SIG=wfs1;CLK=w^ 

NOP W{SIG=wfs2;} " 

NOP V{SIG=L;} 

NOPV{SIG=d;} 

NOP V{SIG=0;}W{SIG=wfs3; } 
NOP V{SIG=n;} W{SIG=wfs4; } 




Figure 12 



wo 2005/114240 



PCT/JP2005/009815 



13/14 



1302 



1307 



CCR 



DLL 



1304 



Resource 
Description 
Component 



1308 



1310 



1312 



1314 



Emulation 
Component 



Pattern 
Compiler |j — \ 
Component 




,wWlodule-/7Y 

^^IS^oLt 



Vendor Module 
Software 



1320 



1322 



Standard 
Interfaces 



1324 



Calibration/ 
Diagnostics 
Framework 



Emulation 
Framework 



Object File 
Manager 
Framework 



1326 



1328 



Open Architecture 
Test System 



Figure 13 



wo 2005/114240 



PCT/JP2005/009815 




INTERNATIONAL SEARCH REPORT 



InterrsKonal Application No 

PCT/JP2005/009815 



A. CLASSIFICATiON OF SUBJECT MATTER 

IPC 7 G01R31/319 



According to International Patent Classification (IPC) or to botri national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classilication system followed by classificatbn symbols) 

IPC 7 GOIR 



Documentation searclied otiier than minimum documentation to the extent that such documents are included In tha fields searched 



Electronic data base consulted during the Intemational search (name ol data base and, where practical, search terms used) 

EPO-Internal , WPI Data, INSPEC, PAJ 



C. DOCUIVIENTS CONSIDERED TO BE RELEVANT 



Category " Citation of document, with inoication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 2003/005375 Al (KRECH ALAN S ET AL) 
2 January 2003 (2003-01-02) 
abstract; claims 1-9; figures 1-6 
paragraph '0020! 
paragraphs '0027! - '0039! 
paragraph '0079! 



1-26 



US 6 028 439 A (ARKIN ET AL) 
22 February 2000 (2000-02-22) 
abstract; claims 1-13; figures 1-9 
column 2, line 66 - column 4, line 8 
line 43 - column 9, line 39 
line 33 - column 16, line 12 



1-26 



column 4, 
column 14 



-/-- 



m 



Further documents are listed In the continuation of box C. 



ID 



Patent family members are listed in annex. 



° Special categories of cited documents : 

'A" document defining the gensral state of the an whicn is not 
considered lo be of particular relevance 

'E' earlier document but publshed on or after the international 
filing date 

"L" document whicti may throw doubts on priority claim(s)or 
which is cited to establish the pubiication date of another 
citation or other speciai reason (as specified) 

'O* document referring to an oral disclosure, use, exhibition or 
other means 

"P" document published prior to the international filing date but 
later ir^an the priority date clainned 



*T* later document published after the iriematlonal filing date 
or priority date and not In conflict with the appication but 
cited to understand the principle or theory underlying the 
invention 

"X" doi;umeiil ol particular relevarrce; the claimed Invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document ol particular relevance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the an. 

'&' document member of the same patent family 



Date of the actual completion of the intemalionai search 



29 July 2005 



Date of mailing of tlie intemational seaich report 



08/08/2005 



Name and mailing address of the ISA 



Authorized officer 



European Patent Office, P.B. 5818 Patentiaan 2 
NL - 2280 HV Rijswiji< 
Tel. (+31-70) 340-2040, Tx. 31 651 eponi. 
Fax: (+31-70) 340-3016 



Nadal, R 



Form PCT/ISA/210 (second sheet) (January 2004) 



INTERNATIONAL SEARCH REPORT 



InterfiPRonal Application No 

PCT/JP2005/009815 



C.(Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document, witti indication, wtiere appropriate, of tlie relevant passages 



Relevant to daim No. 



P,X 



wo 2004/072670 A (ADVANTEST CORPORATION; 

KRISHNASWAMY, RAMACHANDRAN; SINGH, 

HARSANJEET;) 26 August 2004 (2004-08-26) 

abstract; claims 1-23; figures 1-12 

page 2, line 7 - page 4, line 8 

page 6, line 18 - page 10, line 30 

page 11, lines 17-30 

page 12, line 5 - page 13, line 25 

WO 2004/072669 A (ADVANTEST CORPORATION; 
PRAMANICK, ANKAN; ELSTON, MARK; CHEN, 
LEON; SAU) 26 August 2004 (2004-08-26) 
abstract; claims 1-24; figures 1-8 
page 29, line 25 - page 30, line 5 
page 18, line 10 - page 22, line 7 
page 3, line 5 - page 6, line 11 
page 8, line 10 - page 12, line 12 
page 15, line 7 - page 17, line 6 



1-26 



1-26 



PEREZ S M ET AL: "Open architecture test 

system: the new frontier" 

16 July 2003 (2003-07-16), 28TH. 

lEEE/CPMT/SEMI INTERNATIONAL ELECTRONICS 

MANUFACTURING TECHNOLOGY SYMPOSIUM. 

(lEMT). SAN JOSE, CA, JULY 16 - 18, 2003, 

lEEE/CPMT INTERNATIONAL ELECTRONICS 

MANUFACTURING TECHNOLOGY (lEMT) SYMPOSIUM, 

NEW YORK, NY : IEEE, US, PAGE(S) 211-214 , 

XP010655419 

ISBN: 0-7803-7933-0 

the whole document 



1-26 



ForfTi PCT/lSA/210 (continuation of second sheet) (January 2004) 



INTERNATIONAL SEARCH REPORT 



InlenVRonal Application No 

PCT/0P200&/009815 



Patent document 




Publication 




Patent family 




Publication 


cited in search report 




date 




member(s) 




date 


US 2003005375 


Al 


02-01-2003 


NONE 








US 6028439 


A 


22-02-2000 


EP 


1032844 


Al 


06-09-2000 








OP 


2001522049 


T 


13-11-2001 








WO 


9923499 Al 


14-05-1999 


WO 2004072670 


A 


26-08-2004 


US 




Al 


30-09-2004 








US 




fli 

Ml 


21-10-2004 








WO 




Al 


26-08-2004 








WO 




Al 

Mi. 


26-08-2004 








US 




Al 


11-11-2004 








us 




Al 


11-11-2004 








us 


?nntifi'^Qn7Q 

u\J\IO\jOy\J / y 


Al 


17-02-2005 








us 


?flfi'^n??0R7 


Al 


27-01-2005 








us 




Al 


14-07-2005 








us 


£.Uw3 J. J. 


Al 

r\X 


14-07-2005 








wo 




A1 
nx 


14-10-2004 








wo 


2004090552 


Al 


21-10-2004 








us 


2004255216 


Al 


16-12-2004 


WO 2004072669 


A 


26-08-2004 


us 


2004193990 


Al 


30-09-2004 








us 


2004210798 


Al 


21-10-2004 








wo 


2004072669 


Al 


26-08-2004 








wo 


2004072670 


Al 


26-08-2004 








us 


2004225465 


Al 


11-11-2004 








us 


2004225459 


Al 


11-11-2004 








lie 

us 


2005039079 


Al 


17-02-2005 








us 


2005022087 


Al 


27-01-2005 








us 


2005154550 


Al 


14-07-2005 








us 


2005154551 


Al 


14-07-2005 








wo 


2004088339 


Al 


14-10-2004 








wo 


2004090562 


Al 


21-10-2004 








us 


2004255216 


Al 


16-12-2004 





Form PCT/ISA/210 (pateni family annex) (January 2004) 



